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TITLE OF THE INVENTION 
SYSTEM FOR RECORDING AUDIO INFORMATION WITH IMAGE 
CROSS-REFERENCE TO RELATED APPLICATIONS 
This application is based upon and claims the 
benefit of priority from the prior Japanese Patent 
Application No. 11-333389, November 24, 1999, the 
entire contents of which are incorporated herein by 
reference. 

BACKGROUND OF THE INVENTION 

The present invention relates to an improvement in 
a recordable/reproducible information storage medium 
such as a memory card or the like. 

More particularly, the present invention relates 
to an improvement in a removable, portable information 
storage medium suitable for recording/playing back 
digital still image information in combination with 
digital audio information. 

The present invention also relates to a processing 
method of information (still image information, text 
information, or the like, which is associated with 
audio information) recorded on the information storage 
medium . 

Removable, portable information storage media that 
record digital audio information include: 

(A) a CD-DA (compact disc that records digital 
audio in the form of pits ) ; 

(B) a CD-I (CD interactive) or video CD; 



(C) a DVD (digital versatile disc) video or DVD 
audio disc {phase change recording); 

(D) an MD (a disc using magnetooptical 
recording) ; and 

5 (E) solid audio (a semiconductor memory card such 

as a flash memory or the like, etc. 

As the shape of the information storage medium 
itself, media (A) to (D) have a disc shape. In these 
information storage media, a recording layer on each 

10 medium is irradiated with convergent light of a laser 

beam while rotating the medium, and a change in light 
reflected by the recording layer is detected as a 
playback signal. 

By contrast, medium (E) roughly has a card shape 

15 although various sizes and shapes are available. In 

medium (E), digital audio information is recorded in a 
semiconductor memory (mainly, a flash memory) built in 
a card-shaped body, and a recording/playback process of 
audio information is done via electrode terminals 

20 provided to a predetermined portion of the card 

surface. A memory card that belongs to medium (E) is 
used in, e.g., a digital camera. 

In the conventional information storage media 
which has either a disc or card shape, upon editing 

25 (dividing, combining, etc. of a tune or music number) 

the recorded audio information (music piece or the 
like), a method of handling various kinds of 
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information (still image information such as a jacket 
image or the like, text information such as words or 
lyric lines or the like) associated with the edited 
audio information (tune or music number) is not 
5 automated, resulting in troublesome handling for the 

user . 

BRIEF SUMMARY OF THE INVENTION 
The present invention has been made in 
consideration of the above situation and has as its 

10 object to provide an information storage medium having 

information (attribute information such as a display 
order mode/display timing mode and the like, a flag 
indicating the presence/absence of still image 
information, and the like) that pertains to handling of 

15 various kinds of information (still image information 

such as a jacket image or the like, text information 
such as words or the like) associated with audio 
information (tune or music number) . 

It is another object of the present invention to 

20 provide an information playback method using 

information (attribute information such as a display 
order mode/display timing mode and the like, a flag 
indicating the presence/absence of still image 
information, and the like) that pertains to handling of 

25 various kinds of information (still image information 

such as a jacket image or the like, text information 
such as words or the like) associated with audio 
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information (tune or music number). 

In order to achieve the above object, an 
information storage medium according to the present 
invention has a recording region (121) of audio 
5 information (data of AOB: ATS_xx.AOB) and image 

information (data of IOB: IMG_xx.IOB), and has a first 
playback unit (tune or music number) for playing back 
the audio information (ATS_xx.AOB) and a second 
playback unit (AOB/TK) having a fineness being equal to 

10 or more fine than a fineness of the first playback unit 

(tune or music number). In other words, the second 
playback unit (AOB/TK) has a size equal to or smaller 
than the first playback unit (tune or music number). 
The first playback unit (tune or music number) is made 

15 up of one or more second playback units (AOB/TK). One 

or more pieces of management information (AOBI/TKI) 
each pertaining to the second playback unit (AOB/TK) 
are recorded in a line (e.g., in music #J3 in (a) of 
FIG. 10, a sequence of AOBI#2, AOBI#3, and AOBI#4). 

20 Note that display mode information (51, 52) 

indicating a display method (display order, display 
timing) of the image information (IMG_xx.IOB) is 
described in management information (e.g., AOBI#2 in 
music #P in FIG. 10) recorded at the head position in 

25 the first playback unit (tune or music number) of those 

recorded in a line in the second playback unit 
(AOB/TK) . 
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In order to achieve the above object, an 
information playback method according to the present 
invention plays back information from a medium (100, 
170) that records audio information (data of AOB: 
5 ATS_xx.AOB) and image information (data of IOB: 

IMG_xx.IOB) in a first playback unit (tune or music 
number) for playing back the audio information 
(ATS_xx.A0B) and a second playback unit (AOB/TK) having 
a size equal to or smaller than the first playback unit 

10 (tune or music number) . 

When pieces of management information (AOBI/TKI) 
each pertaining to the second playback unit (AOB/TK) 
are recorded in a line (e.g., in music #P in FIG. 10, 
AOBI#2 to AOBI#4) in the medium in which the first 

15 playback unit (tune or music number) is made up of one 

or more second playback units (AOB/TK) (NO in step 
ST1002 in FIG. 25), the contents (e.g., IPI of A0BI#2 
in music #|3 in FIG. 10) of the management information 
recorded at the head position in the first playback 

2 0 unit (tune or music number) are used as valid 

information (step ST1006). The image information 
(IMG_xx.IOB) is played back (step ST1018) by accessing 
the image information (IMG_xx.IOB) on the basis of the 
contents (IPI of AOBI#2 in music #0) of the valid 

25 management information (step ST1016). 

Additional objects and advantages of the invention 
will be set forth in the description which follows, and 
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in part will be obvious from the description, or may be 
learned by practice of the invention. The objects and 
advantages of the invention may be realized and 
obtained by means of the instrumentalities and 
5 combinations particularly pointed out hereinafter. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
illustrate presently preferred embodiments of the 

10 invention, and together with the general description 

given above and the detailed description of the 
preferred embodiments given below, serve to explain the 
principles of the invention. 

FIG. 1 shows views for explaining a case wherein a 

15 plurality of music numbers (tunes) with still images, 

the total of which is equal to or smaller than a 
predetermined value (20 images in this case), and which 
are recorded on an information storage medium (memory 
card or disc) according to an embodiment of the present 

20 invention, are combined by editing. 

FIG. 2 shows views for explaining a case wherein a 
plurality of music numbers (tunes) with still images, 
the total of which exceeds a predetermined value (20 
images in this case), and which are recorded on an 

25 information storage medium (memory card or disc) 

according to an embodiment of the present invention, 
are combined by editing, and a case wherein the 
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combined music number (or combined tune) is divided. 

FIG. 3 shows views for explaining the way in which 
display mode information of the combined music number 
(or combined tune) is handled when a plurality of music 
5 numbers (or tunes) with still images recorded on the 

information storage medium (memory card or disc) are 
combined by editing. 

FIG. 4 shows views for explaining the way in which 
display mode information and text information of 
10 divided music numbers (or divided tunes) are handled 

when a music number (or tune) with still images 
recorded on the information storage medium (memory card 
or disc shown) is divided by editing. 

FIG. 5 shows views for explaining the data 
15 structure (recording format) of a memory card as an 

information storage medium according to an embodiment 
of the present invention. 

FIG . 6 shows views for explaining the recording 
format of an optical disc as an information storage 
20 medium according to another embodiment of the present 

invention. 

FIG. 7 shows a view for explaining the directory 
configuration (hierarchical structure of recorded 
files) of various kinds of information stored in the 
25 information storage medium shown in FIG. 5 or FIG. 6. 

FIG. 8 shows views for explaining an example of 
the playback relationships (arrows in FIG. 8) between a 
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plurality of music numbers (or tunes) and still images 
appended to these music numbers, which are stored in 
the information storage medium shown in FIG. 5 or 
FIG. 6. 

5 FIG. 9 shows views for explaining another example 

of the playback relationships (arrows in FIG. 9) 
between a plurality of music numbers (or tunes) and 
still images appended to these music numbers, which are 
stored in the information storage medium shown in 
10 FIG. 5 or FIG. 6. 

FIG. 10 shows views for explaining an example of 
the way in which a jacket image or the like of each 
music number (or each tune) is displayed when audio 
information with still images recorded on the medium 
15 according to an embodiment of the present invention is 

played back in units of music numbers (in units of 
tunes) or in units of play lists. 

FIG. 11 shows views for explaining an example of 
the way in which jacket images of respective PGCs are 
20 displayed when audio information with still images 

recorded on the medium according to an embodiment of 
the present invention is played back in units of 
program chains (PGCs) or in units of play lists. 

FIG. 12 shows views for explaining another example 
25 of the way in which jacket images of respective music 

numbers (or tunes) are displayed when audio information 
with still images recorded on the medium according to 
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an embodiment of the present invention is played back 
in units of music numbers (in units of tunes) or in 
units of play lists. 

FIG. 13 shows are views for explaining an example 
5 of the playback relationship (arrows in FIG. 13) 

between a plurality of music numbers (or tunes) stored 
in the information storage medium of FIG. 5 or FIG. 6, 
and text (characters, symbols, figures, and/or marks) 
appended to these music numbers. 
10 FIG. 14 shows views for explaining another example 

of the playback relationship (arrows in FIG. 14) 
between a plurality of music numbers (or tunes) stored 
in the information storage medium of FIG. 5 or FIG. 6, 
and text (characters, symbols, figures, and/or marks) 
15 appended to these music numbers. 

FIG. 15 shows views for explaining still another 
example of the playback relationship (arrows in FIG. 
15) between a plurality of music numbers (or tunes) 
stored in the information storage medium of FIG. 5 or 
20 FIG. 6, and text (characters, symbols, figures, 

and/or marks) appended to these music numbers. 

FIG. 16 shows views for explaining the data 
structure of an image object set information 
(IOBSI.IFO) file recorded on the information storage 
25 medium according to an embodiment of the present 

invention . 

FIG. 17 shows views for explaining the data 
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structure of management information (26*) of still 
image ID information in the image object set 
information (IOBSI.IFO) file shown in FIG. 16. 

FIG. 18 shows views for explaining the data 
5 structure of bitmap information (27) of a still image 

file designated as a representative image, jacket 
image, or the like in image object set information 
(IOBSI.IFO) in FIG. 16. 

FIG. 19 shows views for explaining the data 
10 structure of management information that pertains to 

each image object (IMGxx.IOB) in the image object set 
information (IOBSI.IFO) in FIG. 16. 

FIG. 20 shows views for explaining the data 
structure of image pointer information (IPI) shown in 
15 FIGS. 1 to 4, FIGS. 10 to 12, etc. 

FIG. 21 shows a view for explaining the playback 
relationship (broken arrows in FIG. 21) between a 
plurality of music numbers (or tunes) and still images 
appended to these music numbers when cell information 
20 (CI#) in FIG. 10 and the like is changed to read a 

track search pointer (DPL_TK_SRP# ) , audio object 
information (AOBI#) in FIG. 10 and the like is changed 
to read track information (TKI#), and image pointer 
information (IPI#) in FIG. 10 and the like is changed 
25 to read a track information search pointer 

(TKI_lOB_SRP) for an image object. 

FIG. 22 shows views for explaining an example of 
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the format (data structure) when encrypted audio 
information is recorded on the audio card with the copy 
protection function shown in FIG. 5. 

FIG. 23 shows a block diagram for explaining an 
5 example of the arrangement for recording information or 

playing back information on or from the audio card with 
the copy protection function shown in FIG. 5. 

FIG. 24 shows a flow chart for explaining the 
sequence of a mutual authentication process and cipher 

10 key (encryption key) exchange process done between the 

audio card in FIG. 5 (or optical disc shown in FIG. 6), 
and the recording/playback apparatus shown in FIG. 23. 

FIG. 25 shows a flow chart for explaining the 
method of making only an image pointer (IPI) of the 

15 first AOBI (TKI) in a music number or tune (track) 

valid as a pointer of a still image to be displayed 
when the music number or tune (track) is made up of a 
plurality of pieces of AOBI (TKI). 

FIG. 26 shows a flow chart for explaining the 

20 method of matching the display order mode/still image 

display timing mode of divided music numbers (or 
divided tunes) with those before the dividing process, 
matching text information associated with the divided 
music numbers with that before the dividing process, 

25 and copying all kinds of still image information and 

text information in newly created AOBI (TKI) from the 
same kinds of information of AOBI (TKI) older than the 
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new AOBI (TKI ) . 

FIG. 27 shows a flow chart for explaining the 
method of matching the display order mode/still image 
display timing mode of the combined music number (or 
5 combined tune) with those to be played back first by 

merging still image information in a succeeding music 
number (or succeeding tune) with that in a preceding 
music number (or preceding tune) when two music numbers 
or two tunes (tracks) are combined to generate a new 
10 music number or new tune (track). 

FIG. 28 shows a flow chart for explaining the 
method of displaying jacket images using still image 
information of a music number or tune (track) included 
in a selected play list or a selected music 
15 number /selected tune (track) when a play list or music 

number /tune (track) is selected. 

DETAILED DESCRIPTION OF THE INVENTION 
Various embodiments of the present invention will 
be described hereinafter with reference to the 
20 accompanying drawings. 

FIG. 1 shows views for explaining a case wherein a 
plurality of music numbers (tunes) with still images, 
the total of which is equal to or smaller than a 
predetermined value (20 images in this case), and which 
25 are recorded on an information storage medium (memory 

card or disc ) according to an embodiment of the present 
invention, are combined by editing. 
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As shown in (a) of FIG. 1, music #a and music #(5 
are managed by pieces of audio object information 
A0BI#1 (or track information TKI#1) and A0BI#2 (or 
track information TKI#2) as different music numbers or 
5 different tunes. These A0BI#1 (TKI#1) and A0BI#2 

(TKI#2) respectively have image pointer information 
IPI, and are managed by audio object set information 
AOBSI . 

As shown in (a) and (b) of FIG. 1, an audio 

10 information file (audio object ATS_01.AOB) including 

the contents of music #a is designated by AOBIil, and 
still image files (image objects IMG_01.IOB and 
IMG_02.IOB) displayed upon playing back this music #a 
are designated by image pointer information IPI of 

15 AOBI#l (TKI#1). 

Also, as shown in (a) and (b) of FIG. 1, an audio 
information file (audio object ATS_02.AOB) including 
the contents of music #P is designated by AOBI#2 
(TKI#2), and still image files (image objects 

20 IMG_03.IOB and IMG_04.IOB) displayed upon playing back 

this music #{3 are designated by image pointer 
information IPI of A0BI#2. 

Since the capacity of the information storage 
medium (or the image buffer size of an apparatus that 

2 5 plays back the medium) which stores the audio object 

(ATSxx.AOB) and image objects (IMG_yy.IOB) in (b) of 
FIG. 1 is limited, the number of still images that can 
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be displayed per music number (or per tune) has an 
upper limit. 

This upper limit is set to fall within the range 
from around 5 to 100 images in correspondence with the 
5 storage capacity of the medium (or the image buffer 

size of the playback apparatus). 

A case will be examined below wherein the playback 
apparatus can display a maximum of 20 still images per 
music number (tune). 
10 Furthermore, the example shown in FIG. 1 assumes a 

case wherein the total of the number of still images of 
music #a and that of music #P is 20 or less. 

Assume a case wherein the user issues an 
instruction for combining music #oc and music #p into a 
15 single music #y (i.e., makes combining edit). 

In this case, the two audio information files 
(ATS_01.AOB and ATS_02.AOB) remain unchanged, and only 
management information (AOBl/TKI#l and A0BI/TKI#2) is 
rewritten . 

20 That is, of information of a program chain 

(original PGC) indicating the original flow of audio 
programs, the contents of information corresponding to 
image pointer IPI of AOBI#l (TKI#1) and A0BI#2 (TKI#2) 
are partially rewritten, and the rewritten information 

25 (IPI) is re-defined as a portion of music #y. 

The information (IPI) to be written corresponds to 
IPI# in AOBI# in (c) of FIG. 8 or IPI# in cell 



information CI# in (b) of FIG. 9 to be described later. 

When music #oc with still images and music #(3 with 
still images with the configuration shown in (a) and 
(b) of FIG. 1 (these music numbers will be referred to 
5 as previous objects in preceding tracks) are combined, 

single music #y with still images (this music number 
will be referred to as a succeeding object located in 
the next track) is obtained, as shown in (c) of FIG. 1. 
In this case, as shown in (c) and (d) of FIG. 1, 
10 ATS_01.AOB is designated by AOBI#l (TKI#1) included in 

combined music #y, and ATS_02.AOB is designated by 
AOBI#2 (TKI#2) included in combined music #y. 
Furthermore, all image objects (IMG_01.IOB to 
IMG_04.IOB) are designated by only image pointer IPI of 
15 AOBI#l (TKI#1) included in music #y. 

More specifically, when "music numbers or tunes 
are combined" , the designation contents of image 
pointer information IPI in AOBI#l (TKI#1) before 
combining and those of image pointer information IPI in 
20 AOBI#2 (TKI#2) before combining are recorded together 

in image pointer information IPI of management 
information (AOBI/AKI#l) corresponding to an audio 
information file (ATS_01.AOB) which is played back 
first in music #y. 
2 5 In other words, the management information 

(AOBI/TKI) of music #y is obtained by merging the 
management information (AOBl/TKI#l) of music #a and the 
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management information (AOBI/TKI#2) of music #(3. 

As for pointer information IPI that designates 
still images of music #y, only pointer information that 
belongs to the first management information 
5 (A0BI/TKI#1) of those (AOBI/AKI) of music #y is made 

valid. 

That is, image pointer information IPI of A0BI#2 
included in music #y is made invalid in this case, and 
is not used to designate image objects (IMG_01.IOB to 

10 IMG_04.IOB). 

In other words, image pointer information IPI of 
AOBI#l corresponding to a portion (ATS_01.AOB) which is 
played back first upon playing back combined music #y 
can designate all image objects (IMG_01.IOB to 

15 IMG_04.IOB). This is a significant feature of the 

embodiment shown in FIG. 1. 

As a result, upon playing back combined music #y, 
the management information (IPI) of AOBI#2 shown in (c) 
of FIG. 1 need not be temporarily saved in a memory 

20 (RAM) in system controller 3020 of an apparatus shown 

in FIG. 23 (to be described later). 

A memory save can be attained in this way, while 
when only management information AOBI#l in (c) of 
FIG. 1 is temporarily saved in the memory (RAM) of 

25 system controller 3020, all still image file names that 

can be displayed upon playing back music #y can be 
detected from that information, and the switching 
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timing of each still image file (the position of an 
audio frame at which a still image is switched when it 
is played back) can also be detected. 

As a result, the required memory size of the RAM 
5 in system controller 3020 in FIG. 23 can be reduced, 

and the manufacturing cost of the apparatus can also be 
reduced accordingly. 

FIG. 2 shows views for explaining a case wherein 
a plurality of music numbers (tunes) with still images, 

10 the total of which exceeds a predetermined value (20 

images in this case), and which are recorded on an 
information storage medium (memory card or disc) 
according to an embodiment of the present invention, 
are combined by editing, and a case wherein the 

15 combined music number is divided. 

Note that FIG. 2 does not illustrate TKI 
corresponding to AOBI. However, since AOBI corresponds 
to TKI as in FIG. 1, TKI will be inserted as needed in 
parentheses in the following description. 

20 When 11 to 20 still image files are set by each of 

AOBI#l (TKI#1) and AOBI#2 (TKI#2) in (a) of FIG. 1, the 
total number of still images after "combining music 
numbers /combining tunes" exceeds the upper limit 
(20 images) per music number (per tune). A processing 

25 method in such case will be explained below with 

reference to FIG. 2. 

After a plurality of music numbers (#a and #p in 
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(a) of FIG. 2) are combined, when the total number 
of still images of the combined music ( #y in (b) of 
FIG. 2) exceeds the number (20 images) of displayable 
still image per music number (per tune), system 
5 controller 3020 in FIG. 23 to be described later 

appropriately shuffles information (image pointers 
after overlapping portions for identical still images 
are rejected) recorded in image pointer information 
IPI#1 and image pointer information IPI#2 in (a) of 
10 FIG. 2. 

For example, system controller 3020 selects 20 
image pointers of those of shuffled 20 or more still 
images in turn from the first one, thus choosing still 
images to the number of displayable images (20 images) 
15 per combined music number/combined tune (#y). 

As shown in (c) of FIG. 2, the chosen 20 still 
images are recorded in image pointer information IPI#1' 
of AOBI#l (TKI#1) of combined music #y, and non- 
selected still images (extra images exceeding 20 
20 images) are recorded in image pointer IPI#2 ' of AOBI#2 

(TKI#2) to be played back later in single music #y. 

Then, still images to be displayed upon playing 
back music #y after music #a and music #p are combined 
are only (20) still images designated within image 
25 pointer IPI#1' present in management information 

(AOBI#l) that pertains to the audio information file 
which is played back first in music #y. 
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When the user is dissatisfied with still images 
selected by system controller 3020 in FIG. 23 in a 
combining process of music #y, he or she can exchange 
information between image pointer information IPI#1' 
5 and image pointer information ipi#2' using still image 

designation information (image pointer) recorded in 
image pointer information IPI#2' not selected (i.e., 
which is rejected and is tentatively invalid). 

Information exchange between image pointer 
10 information IPI#1' and image pointer information IPI#2' 

can be done by an information recording/playback 
apparatus (multi-function editor) with advanced edit 
functions or a personal computer PC installed with 
required application programs. 
15 Likewise, when music #y with 20 or less display 

images (IPI#1') and rejected images (IPI#2') exceeding 
20 images, and music #n with 20 or less display images 
(IPI#3) and rejected images (IPI#4) beyond 20 images 
are combined again, and the total number of still 
20 images to be displayed exceeds the predetermined value 

(20), display images (IPI#1") of re-combined music #0 
are 2 0 images selected after information of image 
pointer information IPI#1" and information of image 
pointer information IPI#3 are shuffled. 
25 Information (image pointers) indicating other 

rejected images is recorded in image pointer 
information IPI#2", image pointer information IPI#3 ' , 
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and image pointer information IPI#4 of AOBI#2, A0BI#3, 
and AOBI#4. 

At this time information (image pointers) in each 
of image pointer information IPI#2 ' and image pointer 
5 information IPI#4 remains unchanged. This is because 

still images designated in image pointer information 
IPI#2' and image pointer information IPI#4 respectively 
have links to the contents of audio information files 
managed by AOBI#2 and AOBI#4. 

10 As shown in (b) and (c) of FIG. 2, when music #0 

is obtained by combining music #y and music #r|, if 
information (image pointers to rejected images) in 
image pointer information IPI#2 ' and IPI#4 remains 
unchanged, the user can choose still images that match 

15 divided audio information (the contents of divided 

music numbers or divided tunes) by re-editing using the 
multi-function editor or personal computer PC after 
music #0 is divided in future. 

If no re-edit is done, rejected images designated 

20 by image pointer information IPI#2', image pointer 

information IPI#3', and image pointer information IPI#4 
in (c) of FIG. 2 are displayed neither upon playback of 
music #0 nor upon playback of music numbers (#i and #k 
in (d) of FIG. 2) obtained by dividing music #0. 

25 A processing method upon dividing music #0 (which 

is assumed to be a previous object in a preceding 
track) into two music numbers will be explained below. 



A case will be examined below wherein music #9 is 
divided into music #i and music #k (assumed to be new 
objects created on new tracks) in, e.g., the middle of 
A0BI#3 (TKI#3) in (C) Of FIG. 2. 
5 In this case, an audio information file 

corresponding to AOBI#3 (TKI#3) is divided into two 
files. From management information A0BI#3 before the 
dividing process, A0BI#5 (TKI#5) ((d) of FIG. 2) 
corresponding to an audio information file to be played 
10 back last in divided music #i is created. 

Still image information to be displayed during 
playback of divided music #t is designated by image 
pointer information IPI#l"((d) of FIG. 2) in AOBI#l 
(TKI#1) corresponding to an audio information file to 
15 be played back first in music #t. 

At this time, AOBI#l (TKI#1) in (d) of FIG. 2 has 
the same image pointer information IPI#1" as that of 
AOBI#l (TKI#1) in (c) of FIG. 2. That is, information 
of image pointer information IPI#1" before the dividing 
2 0 process shown in (c) of FIG. 2 is directly copied to 

AOBI#l (TKI#1) in (d) of FIG. 2. 

Likewise, from management information AOBI#3 
(TKI#3) before the dividing process, A0BI#6 (TKI#6) 
((d) of FIG. 2) corresponding to an audio information 
25 file to be played back first in divided music #k is 

created. Still picture information to be played back 
during playback of music #k is designated by image 
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pointer information IPI#1" ((d) of FIG. 2) in A0BI#6. 

At this time, A0BI#6 (TKI#6) in (d) of FIG. 2 has 
the same image pointer information IPI#1" as that of 
A0BI#1 in (c) of FIG. 2. That is, information of image 
5 pointer information IPI#1" before the dividing process 

shown in (c) of FIG. 2 is directly copied to A0BI#6 
(TKI#6) in (d) of FIG. 2. 

Since the number of display images of music #9 
before the dividing process has been limited to 20 in 

10 the previous process, if image pointer IPI#1" having 

information (image pointers) that point to these 20 
images is directly copied to divided music #i and music 
#k, no problem is posed in terms of the number of still 
images to be displayed. 

15 Note that image pointer information IPI#1" copied 

to display still images upon playing back music #k may 
have contents which do not match A0BI#6 (TKI#6). in 
this case, the user can change the contents (image 
pointers) of image pointer information IPI#1" to those 

20 which match the contents (audio information designated 

by AOBI/TKI#6) of divided music #k by re-editing them 
using the multi- function editor or personal computer 
PC. 

The combining/dividing method for music number 
2 5 described with reference to FIGS. 1 and 2 is a 

processing method complying with the data structure 
shown in FIG. 8 to be described later. However, the 
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present invention is not limited to such specific 
method, and the music number combining/dividing process 
of FIGS. 1 and 2 may be executed in accordance with the 
data structure shown in FIG. 9 to be described later. 
5 Note that image pointer information IPI is 

recorded not in audio object information AOBI (TKI) 
but in cell information CI when the music number/tune 
combining/dividing process is executed in accordance 
with the data structure shown in FIG. 9. 

10 Furthermore, the aforementioned image pointer 

information IPI forms a part of all kinds of 
information that pertain to still picture objects. 

FIG. 3 shows views for explaining the way in which 
display mode information of the combined music number 

15 is handled when a plurality of music numbers with still 

images recorded on the information storage medium 
(memory card or disc) are combined by editing. 

Note that the subsequent figures do not describe 
TKI corresponding to AOBI, but TKI corresponds to AOBI 

20 as in FIG. 1 or FIG. 2. 

A method of setting a jacket image in units of 
music numbers (in units of tunes) or setting a 
representative image of a given music number (given 
tune) upon a "music combine/tune combine" process will 

25 be explained below using FIG. 3. 

A case will be examined below wherein a single 
still image (IMG_02.IOB) is displayed upon playing back 
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music #a before the combining process , and two still 
images (IMG_03.IOB and IMG_04.IOB) are displayed upon 
playing back music #5. (These music #a and music #5 
are assumed to be previous objects located on preceding 
5 tracks. Also, combined music #s is assumed to be a 

succeeding object located in the next track.) 

Upon playing back music #a, IMG_02.IOB is 
displayed as a representative image of that music 
number. However, since IMG_03.IOB is displayed first 

10 upon playing back music #5, IMG_03.IOB is set as a 

representative image of music #8. 

Representative images shown in (b) of FIG. 3 can 
be used as some (or all) of jacket images for music #oc 
or music #8, or can be used as some (or all) of jacket 

15 images for the entire medium (a card shown in FIG. 5 or 

a disc shown in FIG. 6) that records these music 
numbers . 

After the combining process, as shown in (c) and 
(d) of FIG. 3, AOBI#l and AOBI#7 themselves remain 

20 unchanged, and ATS_01.AOB and ATS_07.AOB as audio 

information files also remain unchanged. However, all 
pieces of information that pertain to still pictures 
are concentrated in IPI#1 in AOBI (TKI) #1 as 
management information for audio information file 

25 ATS_01.AOB to be played back first in music #s together 

with display mode information indicating the display 
order/display timings of one or more still images and 
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jacket image setting information or representative 
image setting information. 

The display order is IMG_02.IOB, IMG_03.IOB, and 
IMG_04.IOB in correspondence with that before the 
5 combining process shown in (a) of FIG. 3. (This 

display order or display sequence can be specified by 
display mode information to be described later with 
reference to FIG. 10 or FIG. 20.) 

As a representative image (or jacket image) for 
10 combined music #6, IMG_02.IOB to be displayed first is 

automatically set. 

In the configuration shown in FIG. 3 r IMG_02.IOB 
to IMG_04.IOB including an image object set as the 
representative image can be used not only as a jacket 
15 image of music #8, but also as word cards including 

images of words (text information) of that music 
number . 

The display order and display timings of one or 
more jacket images or word cards can be determined by 
20 display mode information (51, 52) in FIG. 20. 

Furthermore, the display timings of one or more 
jacket images or word cards can be determined in 
synchronism with audio frames (transfer units of audio 
data) in (c) of FIG. 22. In this way, words can be 
25 displayed while being switched along with the progress 

of song. 

Note that display mode information (FIG. 10, 
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FIG. 20) of still images (jacket image, word cards, and 
the like) of music #s is recorded in the first AOBI 
(first TKI) of music #b. In music #e, only this first 
AOBI (first TKI) is valid (for still image display 
5 control ) . 

FIG. 4 shows views for explaining the way in which 
display mode information, text information, and the 
like of divided music numbers are handled when a music 
number with still images recorded on the information 

10 storage medium (a card shown in FIG. 5 or a disc shown 

in FIG. 6) is divided by editing. 

A method of setting a jacket image in units of 
music numbers (in units of tunes) or setting a 
representative image of that music number (tune) upon a 

15 "dividing music number (dividing tune)" process will be 

explained below using FIG. 4. 

Assume that one still image IMG_02.IOB is 
displayed upon playing back music #oc ((a) of FIG. 4) 
before the dividing process, and IMG_02.IOB is set as a 

20 representative image (or jacket image) indicating the 

contents of this music #a. 

When music #a in (a) of FIG. 4 is divided into 
music #a and music #C by the music number dividing 
process, as shown in (c) of FIG. 4, original audio 

25 object information (AOBI#l in (a) of FIG. 4 is divided 

into AOBIfl and AOBI#8 ((c) of FIG. 4). Also, as shown 
in (d) of FIG. 4, the audio information file is divided 
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into ATS_01.AOB and ATS_08.AOB in accordance with the 
dividing situation. 

At this time, the contents of text pointer 
information TPI#1 and image pointer information IPI#1 
5 in A0BI#1 before the dividing process are directly 

copied to TPI#1 and IPI#1 in A0BI#1 and TPI#8 and IPI#8 
in A0BI#8 after the dividing process. 

As a result, IMG_02.IOB ((d) of FIG. 4) is 
designated as the representative images or jacket 
10 images (or word cards including word text) for both 

music #a and music #£. 

The aforementioned text pointer information TPI 
forms a part of all kinds of information that pertain 
to text. 

15 FIG. 5 shows views for explaining the data 

structure (recording format) of information recorded in 
audio card (memory card) 100 as an information storage 
medium according to an embodiment of the present 
invention . 

20 The information storage medium (audio card/memory 

card) shown in FIG. 5 has a card shape as large as the 
size of a name card, a stick of gum, or a stamp, and 
comprises electrodes (not shown in FIG. 5) for 
connecting an external apparatus (not shown in FIG. 5) 

25 at a predetermined position on the outer side of card 

100. As will be described later, information is 
input /output from/ to an information playback apparatus 



or information recording/playback apparatus (see 

FIG. 23) using card 100 in FIG. 5 via these electrodes. 

The main body of this audio card/memory 100 
comprises a semiconductor IC prepared by assembling a 
microcomputer and its peripheral devices in a 64MB 
flash memory (EEPROM) . 

As shown in (a) of FIG. 5, audio card 100 has a 
copy protection function, and can prevent illicit copy 
or use of information recorded in audio card 100. 

That is, with respect to an external apparatus 
(information playback apparatus or information 
recording/playback apparatus), audio card 100 itself 

(A) makes mutual authentication and cipher key 
(encryption key) exchange, 

(B) inputs and outputs encrypted information, and 

(C) allows only a partner (information playback 
apparatus or information recording/playback apparatus) 
authenticated by audio card 100 to use correct 
(decrypted) information. 

Such mutual authentication, cipher key (encryption 
key) exchange, encryption/decryption (decipher) of 
information, and information I/O interface process are 
executed by control CPU (MPU) 101 in the audio card. 

A program executed by control CPU 101 in the audio 
card is stored in authentication/key exchange & I/O 
process related control program recording ROM 102. 

In the information playback apparatus or 



information recording/playback apparatus (see FIG. 23), 
authentication/ identification is done for each audio 
card 100 to manage security of information transferred 
and input to each card 100. 

As a security means for information management in 
units of cards done by the information 
recording/playback apparatus, audio card 100 has a 
unique ID, and can set a unique cipher key. 

That is, the unique ID (the manufacturer name, 
product name, lot number, serial number, or the like) 
assigned to each audio card 100 and unique cipher key 
(encryption key) information are recorded in card 
unique ID information & key information recording 
region (RAM) 103. 

Audio card 100 with the copy protection function 
also has application data recording region (RAM) 104, 
which can record audio information (audio object AOB), 
still image information (image object IOB), text 
information (text object TOB), management information 
(AOBSI.IFO, I0BSI.IF0, and TOBSI.IFO in FIG. 7) that 
manages those information, and the like. 

As shown in (b) of FIG. 5, application data 
recording region (RAM) 104 is made up of boot 
information recording region 110, file allocation table 
(FAT) recording region 111, root directory information 
recording region 112, and data region 113. 

That is, the file format of data recorded in 
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application data recording region (RAM) 104 adopts the 
FAT format. 

When audio card 100 with the copy protection 
function shown in FIG. 5 is inserted into the 
5 information recording/playback apparatus (see FIG. 23), 

the information recording/playback apparatus reads 
information recorded in boot information recording 
region 110, and automatically boots (activates) itself. 
After that, when the information 
10 recording/playback apparatus plays back desired 

information (music, still images, and the like) from 
card 100, it reads file allocation information in FAT 
recording region 111 to detect the storage address of 
desired information to be played back, and accesses 
15 application data recording region (RAM) 104 based on 

the detected address. 

In data region 113, audio related information 
recording region 121 and one or more general computer 
information recording regions 120 can be arbitrarily 
2 0 set together, as shown in (c) of FIG. 5. 

As shown in (d) of FIG. 5, audio related 
information recording region 121 is comprised of 
management information recording region 130, audio 
object (AOB) recording region 131, image object (IOB) 
25 recording region 132, and text object (TOB) recording 

region 133. 

Audio information recorded in audio card 100 is 
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stored in AOB recording region 131, still image 
information recorded in audio card 100 is stored in IOB 
recording region 132, and text information recorded in 
audio card 100 is stored in TOB recording region 133. 
5 On the other hand, management information (map 

information or the like) that pertains to these audio 
information, still image information, and text 
information, and management information (search 
pointers or the like) indicating links among 
10 information are stored in management information 

recording region 130. 

This management information recording region 130 
is divided into four recording regions, as shown in (e) 
of FIG. 5. 

15 That is, management information recording region 

130 is made up of program chain set information (PGCSI) 
recording region 140, audio object set information 
(AOBSI) recording region 141, image object set 
information (IOBSI) recording region 142, and text 

2 0 object set information (TOBSI) recording region 143. 

PGCSI recording region 140 is formed of original 
PGC (ORG_PGC) information recording region 150 for 
storing information of an original program chain, and 
one or more user-defined PGC (UD_PGC) recording regions 

25 151, 152,..., for storing information of new program 

chains defined by the user in use of card 100, as shown 
in (f) of FIG. 5. 
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ORG_PGC information recording region 150 is 
comprised of recording region 160 of information 
indicating the total number of cells (information units 
that form a PGC) present in the original PGC, and one 
5 or more cell information (CI) recording regions 161, 

162,..., as shown in (g) of FIG. 5. 

In audio card (memory card) 100 with the 
aforementioned data structure, the recorded contents 
such as music information, and the like are stored at 
10 corresponding locations in recording regions 131 to 133 

in (d) of FIG. 5. 

Also, management information (a method of playing 
back an edited music number (edited tune) and 
corresponding images/text, and the like) after the user 
15 has edited the stored recorded contents (e.g., 

processes for combining music number, dividing music 
number, erasing music number, moving music number, and 
so on) is stored at a corresponding location in 
recording region 130 in (d) of FIG. 5. 
20 In the embodiment of the present invention, as 

memory card 100 with the copy protection function shown 
in FIG. 5, an audio card that records audio 
information/image information/text information 
protected from illicit copy/illicit use is assumed. 
2 5 However, memory card 10 0 shown in FIG. 5 can be 

used to record not only such audio information but also 
application files (or PC data) such as a wordprocessor , 
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spreadsheet, and the like used in general personal 
computer PC ( a recording region for such data is 
denoted by 120 in (c) of FIG. 5). 

In this case, using the authentication/key 
5 exchange & I/O related control program stored in ROM 

102 and card unique ID and key information stored in 
RAM 103 in (a) of FIG. 5 as needed, application files 
(or PC data) such as a wordprocessor, spreadsheet, 
game, and the like can be prevented from being 

10 illicitly copied/used. 

That is, memory card 100 shown in FIG. 5 can be 
used as package media that distribute computer programs 
(application programs, game programs, and the like) to 
be protected from illicit copy /use (for pay or free). 

15 FIG. 6 shows views for explaining the recording 

format of an optical disc as an information storage 
medium according to another embodiment of the present 
invention. 

Audio card (memory card) 100 shown in (a) of FIG. 
20 5 is a card-shaped medium which does not move itself in 

use, but disc-shaped medium 170 shown in (a) of FIG. 6 
itself rotates in use. 

As an example of recordable/reproducible disc- 
shaped medium 170, a hard disc drive HDD (especially, 
25 HDD using a removable recording medium) , large-capacity 

floppy disc drive FDD (recently, FD with a capacity of 
100 MB or more is commercially available), 
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magnetooptical MO, DVD-RAM, DVD-R, DVD-RW, and the like 
are known. 

The file format of the HDD or MO adopts the FAT 
format that has been explained with reference to (b) of 
5 FIG. 5, but the DVD-RAM, DVD-R, DVD-RW, and the like 

adopt the universal disc format (UDF). 

Rewritable data region 1820 in (b) of FIG. 6 has a 
hierarchical data structure shown in (c) to (g) of 
FIG. 6. This data structure is the same as that which 
10 has already been explained with reference to (c) to (g) 

of FIG. 5. 

Upon accessing information (for example, files in 
the directory structure shown in FIG. 7 to be described 
later) recorded on disc-shaped medium 170, volume & 
15 file structure information 1810 is played back first. 

This volume & file structure information 1810 includes 
UDF information used to access data files shown in 
FIG. 7. 

FIG. 7 is a view for explaining the directory 
20 configuration (hierarchical structure of recorded 

files) of various kinds of information stored in memory 
card 100 in FIG. 5 that adopts FAT or disc-shaped 
medium 170 in FIG. 6 that adopts UDF. 

Information recorded in application data recording 
25 region (RAM) 104 in (a) of FIG. 5 has a hierarchical 

directory structure as shown in FIG. 5, and information 
in root directory 2000 in FIG. 7 is recorded in root 
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directory information recording region 112 in {b) of 
FIG. 5. 

Alternatively, information recorded in data region 
1820 in (b) of FIG. 6 has a hierarchical directory 
5 structure shown in FIG. 7, and information in root 

directory 2000 in FIG. 7 is recorded in volume & file 
structure information 1810 in (b) of FIG. 6. 

Even when either audio card 100 with the copy 
protection function that adopts the FAT format, as 

10 shown in FIG. 5, or disc-shaped information storage 

medium 170 that adopts the UDF format, as shown in 
FIG. 6 is used as the information storage medium, 
information recorded in the information storage medium 
is recorded in units of files, as shown in FIG. 7. 

15 Audio information (AOB) with still images (IOB) 

described with reference to FIGS. 1 and 2 is recorded 
together in subdirectory 2001 named real-time audio 
recording directory 2100, as shown in FIG. 7. 

This real-time audio recording directory 2100 has 

20 data file 2002 including files 2110 to 2140, 2310, 

2320, 2500,... to be described below as subdirectories. 

Audio information (audio object AOB) recorded in 
the information storage medium shown in FIG. 5 or 
FIG. 6 is recorded in units of files such as ATS_01.AOB 

25 2500, and the like, as shown in FIG. 7. Details of 

audio object file (audio information file) 2500 will be 
explained later with reference to FIG. 22. 
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These audio information files (ATS_01.AOB 
2500,...) are recorded and saved in audio object 
recording region 131 in (d) of FIG. 5 or 6 . 

Image information (image object IOB) recorded in 
5 the information storage medium shown in FIG. 5 or 

FIG. 6 is recorded as independent files like IMG_01.IOB 
2310, etc., in units of images (still images), as shown 
in FIG. 7. 

These image information files (IMG_01.IOB 
10 2310,...) are recorded and saved in image object 

recording region 132 in (d) of FIG. 5 or 6 . 

Furthermore, the information storage medium shown 
in FIG. 5 or FIG. 6 can record text information (text 
object TOB) such as words, comments for played music 
15 numbers (tunes), profiles of a player, and the like in 

units of files like TXT_01.TOB 2320, , as shown in 

FIG. 7. 

These text information files (TXT_01.TOB 2320, ) 

are recorded and saved in text object recording region 

20 133 in (d) of FIG. 5 or 6. 

All pieces of management information that 
pertain to audio information (audio object AOB) 
recorded in audio object recording region 131 are 
recorded together in single file 2120 named AOBSI.IFO, 

25 as shown in FIG. 7. The recording location of this 

AOBSI.IFO file is audio object set information AOBI 
recording region 141 in (e) of FIG. 5 or 6. 
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All pieces of management information that pertain 
to still image information (image object IOB) recorded 
in image object recording region 132 are recorded 
together in file 2130 named IOBSI.IFO. The recording 
5 location of this IOBSI.IFO file 2130 is image object 

set information recording region 142 in (e) of FIG. 5 
or 6 . 

Likewise, all pieces of management information 
that pertain to text information (text object TOB) 
10 recorded in text object recording region 133 are 

recorded together in file 2140 named TOBSI.IFO. The 
recording location of this TOBSI.IFO file 2140 is text 
object set information recording region 143 in (e) of 
FIG. 5 or 6. 

15 Even when the information storage medium has a 

shape of either audio card 100 with the copy protection 
function or disc-shaped information storage medium 170, 
all pieces of management information that indicate the 
playback order of all pieces of audio information (all 

20 AOBs) recorded in the information storage medium are 

recorded together in single file 2110 named PGCSI.IFO, 
as shown in FIG. 7. The recording location of this 
PGCSI.IFO file 2110 is program chain set information 
recording region 140 in (e) of FIG. 5 or 6. 

25 Note that a program chain (PGC) is made up of one 

or more cells C, as will be described later, and has a 
structure that can define the playback sequence (or 
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playback order) of music numbers (tunes) in the PGC by 
means of the layout order (or arrangement) of cells C, 
as shown in (b) of FIG. 8, or in (g) of FIG. 5 or 6 . 
When data of recordable /reproducible DVD video 
5 (DVD_RTR) is recorded in the data region of the medium 

shown in FIG. 5 or FIG. 6, DVD_RTR directory 2200 
including DVD_RTR data files is assured as a 
subdirectory of root directory 2000 in FIG. 7. 

When data of DVD audio is recorded in the data 
10 region of the medium shown in FIG. 5 or FIG. 6, DVD 

audio directory 2300 including data files 
(ATS_01_0.IFO; ATS_0 1_0 . AOB, and the like) of DVD audio 
is assured as a subdirectory of root directory 2000 
shown in FIG. 7. 
15 Furthermore, subdirectory 2400 that manages flags 

indicating the presence/absence of still image data 
(indicating whether still image data are 
recorded/unrecorded) is assured under root directory 
2000 in FIG. 7. 
20 For example, system controller 3020 in FIG. 23 

accesses hierarchical file information in FIG. 7 from 
card 100 in FIG. 5 or disc 170 in FIG. 6, and can read 
the contents (still image data flags; see FIGS. 16 to 
19) of subdirectory 2400 before playback of a music 
25 number (or tune) . 

Then, upon accessing the contents (audio objects, 
image objects, text objects, and the like) in real-time 



- 39 - 



audio recording directory 2100 in FIG. 7 upon playing 
back a music number (or tune), image objects with 
"unrecorded" flags ("00" in (c) of FIG. 17) can be 
skipped (that is, unwanted access can be avoided from 
5 being generated) . 

Since no unwanted access is generated, and still 
images can be smoothly read (i.e., only required still 
image objects can be quickly accessed), desired images 
(word card images, and the like) can be played back at 

10 just timings without being delayed from the flow of 

music number (tune) even when still image data are not 
stored in advance in a buffer memory of the playback 
apparatus. Here, in the example shown in FIG. 1, a 
maximum of 20 images in unit of music number (or in 

15 unit of tune) forms the above still image data. 

FIG. 8 shows views for explaining an example of 
the playback relationships (arrows in FIG. 8) between a 
plurality of music numbers (tunes) and still images 
appended to these music numbers, which are stored in 

20 the information storage medium shown in FIG. 5 or 

FIG. 6. The relationship among respective kinds of 
management information will be explained below using 
FIG. 8. 

In the embodiment of the present invention, all 
2 5 pieces of audio information (all AOBs) recorded on the 

information storage medium are managed using units 
called " music numbers (tunes)". 
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Furthermore, music numbers or tunes recorded on 
the information storage medium have information of the 
sequence for successively playing back all music 
numbers (tunes) in turn, and a region where the 
5 sequence information (program chain PGC) which is 

created first is recorded is called original PGC 
(ORG_PGC) information recording region 150 (see (f) of 
FIG. 5, (f) of FIG. 6(f), or (a) of FIG. 8). 

Management information (AOBSI) that pertains to 

10 audio information (AOB) has an independent management 

information unit (A0BI#1 to A0BI#5) for each audio 
information file (AOB file) like ATS_01.AOB to 
ATS_05.AOB (each corresponding to ATS_01.AOB 2500 in 
FIG. 7) shown in (d) of FIG. 8. As such management 

15 information units, pieces of audio object information 

AOBI#l, AOBI#2, AOBI#3, AOBI#4, and AOBI#5 are set, as 
shown in (c) of FIG. 8. 

Pieces of audio object information A0BI#1 to 
AOBI#5 respectively have pieces of time map information 

20 (TMI) 181 to 185 each including information that 

indicates the relationship between the playback time 
and recording location (address) in the medium to allow 
special playback such as time search, f astforwarding 
(FF), f astrewinding (FR), and the like. 

25 In the embodiment shown in FIG. 8, pieces of audio 

object information AOBI#l to AOBI#5 include information 
of pieces of image pointer information IPI#1 to IPI#5, 



which can directly designate still image information 
files IMG_01.IOB to IMG_03.IOB. 

As shown in (b) and (c) of FIG. 8, a size 
designated by pieces of cell information CI#1 to CI#5 
5 defined in original PGC information recording region 

150 has one-to-one correspondence with the total 
playback range indicated by pieces of corresponding 
audio object information AOBI#l to AOBI#5. 

As shown in (b) of FIG. 8, one or more pieces of 
10 cell information CI form each of music #a f music 

and music #y. Information indicating the relationship 
between each cell information CI and a music number 
(tune) is described in pieces of cell information CI#1 
to CI#5. 

15 As described above, the playback order of the 

original PGC is defined by the layout order of 
corresponding cell information CI . but the playback 
sequences in units of music numbers (in units of tunes) 
are described in original PGC information recording 

20 region 150 in terms of the relationship with music 

numbers (tunes) shown in (b) of FIG. 8. 

In addition to the playback sequence indicated by 
the original PGC, unique playback sequence information 
set by the user is recorded in user-defined PGC 

25 recording region 151. Pieces of cell information CI#11 

to CI#13 defined in user-defined PGC recording region 
151 have a structure capable of setting corresponding 



audio object information AOBI (AOBI#3 to A0BI#5 in (c) 
of FIG. 8) and the playback start and end times in time 
map information (TMI 183 to TMI 185 in (c) of FIG. 8) 
defined in the AOBI. 

Therefore, by setting cell information CI in (b) 
of FIG. 8 in turn, an arbitrary playback sequence for 
audio information (audio object AOB) can be defined in 
user-defined PGC recording region 151. 

In the example shown in (b) of FIG. 8, since cell 
information CI#11 designates a portion in time map 
information TMI 185, the playback range of music #y' 
that cell information CI#11 defined in the user-defined 
PGC plays back can play back only a range narrower than 
that of music #y defined in the original PGC. 

As described above, according to the embodiment of 
the present invention, an arbitrary range can be played 
back without being limited by the playback range of a 
music number (tune) defined in the original PGC. 

The user can set a plurality of arbitrary playback 
sequences in user-defined PGC recording region 151. A 
plurality of user-defined PGC recording regions #A151, 
#B152,... can be defined in units of playback sequences 
designated by the user, as shown in (f) of FIG. 5 or 6. 

In the embodiment shown in FIG. 8, image pointer 
information IPI#2 is set to display two still images 
IMG_02.IOB and IMG_03.IOB during playback of music #{5. 

in the embodiment of the present invention, still 
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image file information to be displayed for each music 
number (each tune) is described in image pointer 
information IPI#2 (corresponding to 192 in FIG. 8 or 
197 in FIG. 9) in audio object information (for 
5 example, corresponding to cell information CI #2 in 

A0BI#2 in music #p) to be played back first in that 
music number. 

FIG. 9 shows views for explaining another example 
of the playback relationships (arrows in FIG. 9) 
10 between a plurality of music numbers (tunes) and still 

images appended to these music numbers, which are 
stored in the information storage medium shown in FIG. 
5 or FIG. 6. The differences from FIG. 8 will be 
explained below. 
15 The embodiment shown in FIG. 9 has pieces of 

image object information I0BI#1 and IOBI#2 as 
individual management information for still image 
information files IMG_01.IOB and IMG_02.IOB. 

When one of pieces of image pointer information 
20 IPI#1 to IPI#3, IPI#13, and IPI#14 points to pieces of 

image object information I0BI#1 and I0BI#2, still image 
information files IMG_01.IOB and IMG_02.IOB to be 
simultaneously displayed upon playing back audio 
information are designated. 
25 Unlike in the embodiment shown in FIG. 8, pieces 

of image pointer information IPItl to IPI#3, IPI#13, 
and IPI#14 are respectively set in pieces of cell 



information CI#1 to CI#3, CI#13, and CI#14. 

In the embodiment shown in FIG. 8, still image 
information files to be displayed upon playing back 
music #y' and music #p' defined in user-defined PGC 
5 recording region 151 match those to be displayed upon 

playing back music #y and music #p defined in original 
PGC recording region 150, and still image information 
files to be displayed upon playback cannot be 
arbitrarily set (changed) . 
10 By contrast, in the embodiment shown in FIG. 9, 

since image pointer information IPI# is set in each 
cell information CI#, still image information files to 
be displayed upon playback can be arbitrarily set in 
units of cells. 

15 FIG. 10 are views for explaining an example of the 

way in which a jacket image or the like of each music 
number is displayed when audio information with still 
images recorded on the medium according to an 
embodiment of the present invention is played back in 

20 units of music numbers or in units of play lists. 

In the embodiment of the present invention, all 
pieces of audio information (audio objects AOB) 
recorded on the information storage medium are managed 
using units called "music numbers or tunes". 

25 Music numbers (tunes) recorded on the information 

storage medium have sequence information for 
successively playing back all music numbers in turn, 
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and a region where this information is recorded is 
called original PGC (original program chain) 
information recording region 150. 

Management information that pertains to audio 
5 information (AOB) has an independent management 

information unit for each audio information file (AOB 
file) like ATS_xx.A0B (xx is an integer starting from 
01), and pieces of audio object information (AOBI) #1, 
#2, #3, . . . are set. 
10 Each audio object information AOBI# has time map 

information having relationship information between the 
playback time and recording location (address) to allow 
special playback such as time search, f astf orwarding 
(FF), f astrewinding (FR), and the like. 
15 Also, audio object information AOBI# can include 

image pointer information IPI#. From this IPI, still 
image information file IMG_xx.IOB (xx is an integer 
starting from 01) is directly designated. 

A size designated by each cell information CI# 
20 defined in original PGC information recording region 

150 has one-to-one correspondence with the total 
playback range indicated by corresponding audio object 
information AOBI # 1 . 

Each of music #a, music #P, and music #y is made 
25 up of one or more pieces of cell information CI#. 

Information indicating correspondence between each CI# 
and a music number (tune) is described in each CI#. 



- 46 - 



In this embodiment, the playback order of the 
original PGC is defined by the layout order of 
corresponding CI#. but the playback sequences in units 
of music numbers (in units of tunes) are described in 
original PGC information recording region 150 in terms 
of the relationship with corresponding music numbers 
(tunes ) . 

In addition to the playback sequence indicated by 
the original PGC, unique playback sequence information 
set by the user is recorded in user-defined PGC 
recording region 151. 

Cell information CI# defined in user-defined PGC 
recording region 151 has a structure capable of setting 
corresponding audio object information AOBI and the 
playback start and end times in time map information 
defined in the AOBI. 

Hence, by setting Cl# in turn, an arbitrary 
playback sequence for audio information (AOB) can be 
defined in user-defined PGC recording region 151. 

Since cell information CI# designates a portion in 
time map information, the playback range of music # 
that CI# plays back can play back a range narrower than 
that of corresponding music #y defined in the original 
PGC. 

In this way, an arbitrary range can be played back 
without being limited by the playback range of a music 
number (tune) defined in the original PGC. 
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The user can set a plurality of arbitrary playback 
sequences in user-defined PGC recording region 151, and 
a plurality of user-defined PGC (program chain) 

recording regions #A, #B, can be defined in units of 

5 playback sequences designated by the user. 

As shown in (a) of FIG. 10, recording region 140 
(see FIG. 5) of program chain set information (PGCSI) 
has recording region 150 of the original PGC (ORG_PGC) 
and recording region 151 of one or more user-defined 
10 PGCs (UD_PGC#A). 

In this case, music #oc, music #p, and music #y are 
recorded in ORG_PGC recording region 150, and music #0 
and music #y are recorded in UD_PGC#A recording region 
151. 

15 a PGC (program chain) is made up of one or more 

cells C, and the playback sequence (playback order) of 
music numbers (tunes) in the PGC can be defined by the 
layout order of these cells. 

Music #a in ORG_PGC recording region 150 has cell 

20 information CI#1 including text information TXI#1 (text 

information including text pointer information TPI# 
shown in FIG. 4 or FIGS. 13 to 15) and image pointer 
information IPI#1. This IPI#1 designates management 
information of still image IMG_02.IOB included in 

25 recording region 142 of image object set information 

(IOBSI) . 

When this still image IMG_02.IOB is played back 
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simultaneously with the beginning of playback of music 
#a, an image of "bruin" shown in (d) of FIG. 10 is 
displayed as an image that represents the first music 
#oc in the original PGC (or a jacket image) (on, e.g., 
5 image display 3710 in FIG. 23 to be described later) 

simultaneously with the beginning of playback of music 
#a. 

Note that audio information (audio data) of music 
#oc corresponds to ATS_01.AOB designated via A0BI#1. 

10 Music #(3 in 0RG_PGC recording region 150 has CI#2 

including TXI#2 and IPI#2, CI#3 including TXI#3 and 
IPI#3, and CI#4 including TXI#4 and IPI#4. 

IPI#2 in CI#2 that designates audio information 
ATS_02.AOB (via AOBI#2) to be played back first in this 

15 music #0 has three image pointers <1>, <2>, and <3>. 

Of these pointers, first pointer IPI#2 <1> designates 
management information of still image IMG_04.IOB 
included in IOBSI recording region 142. 

When this still image IMG_04.IOB is played back 

20 simultaneously with the beginning of playback of music 

#3, an image of "running businessman" shown in (d) of 
FIG. 10 is displayed as an image that represents the 
second music #P in the original PGC (or a jacket image) 
simultaneously with the beginning of playback of music 

25 #P. 

Note that second pointer IPI#2 <2> in music #0 
designates still image IMG_02.IOB ("bruin"), which is 
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displayed as the second image of music #P, as, e.g., a 
second jacket image. Also, third pointer IPI#2 <3> of 
music #p designates still image IMG_03.IOB, which is 
displayed as the third image of music #0, as, e.g., a 
5 third jacket image (not shown). 

"Bruin" of IMG_02.IOB in (d) of FIG. 10 is a 
representative image for music #oc of the original PGC 
but is not a representative image for music #(3 of the 
original PGC. However, this "bruin" can be jacket 
10 images of both music #a and music #0. 

Music #y of ORG_PGC recording region 150 has CI#5 
including TXI#5 and IPI#5, and CI#6 including TXI#6 and 
IPI#6. 

IPI#5 in CI #5 that designates audio information to 
15 be played back first in this music #y has two image 

pointers <1> and <2>. Of these pointers, first pointer 
IPI#5 <1> designates management information of still 
image IMG_01.IOB included in IOBSI recording region 
142. 

20 When still image IMG_01.IOB is played back 

simultaneously with the beginning of playback of music 
#y, an image of "personal computer" shown in (d) of 
FIG. 10 is displayed as an image that represents the 
third music #y in the original PGC (or a jacket image) 

25 simultaneously with the beginning of playback of music 

#y. 

Note that second pointer IPI#5 <2> of music #y 
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designates still image IMG_04.IOB ("running 
businessman" ) which is displayed as the second image of 
music #y. 

"Running businessman" of IMG_04.IOB in (d) of 
FIG. 10 is a representative image for music #3 of the 
original PGC (original play list), but is not a 
representative image for music #y of the original PGC. 
However, this "running businessman" can be jacket 
images for both music #y and music #p of the original 
PGC. 

On the other hand, in 
UD_PGC (user-defined play list) #A in which the user 
re-arranges music numbers (tunes) to have #P as the 
first music number (first tune) and #y as the second 
one, IPI#11 of the first music #p designates management 
information of still image IMG_03.IOB, and IPI#12 of 
the second music #y designates management information 
of still image IMG_01.IOB (image of "personal 
computer" ) . 

Although not shown in (d) of FIG. 10, the contents 
of text information designated by corresponding text 
information TXI# (or its text pointer information TPI#) 
can be superimposed as needed on the representative 
image (or jacket image) to be displayed. 

As alternative names of terms used in this 
specification, for example, the original PGC may be 
called a default play list (original play list), the 
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user-defined PGC may be called a play list, a cell may 
be called a default play list track search pointer/play 
list track search pointer, audio object information may 
be called track information, and image pointer 
5 information IPI may be called an image object search 

pointer. 

In the data structure shown in FIG. 10, the user- 
defined PGC can only designate a playback sequence as a 
sequence of "music number units" or "tune units" 
10 prescribed in the original PGC. 

Each of CI#11 and CI#12 set in the user-defined 
PGC designates only audio information to be played back 
first in "music number" or in "tune" defined in the 
original PGC. 

15 in order to change setups to play back in the 

order of "music #y -» music #P" in user-defined PGC#A 
recording region 151, CI#11 can designate AOBI#5 as 
management information of ATS_05.AOB to be played back 
first in music #y, and the next CI#12 can designate 

20 A0BI#2 as management information of ATS_02.AOB to be 

played back first in music #(3. 

in the embodiment shown in FIG. 10, since only one 
still image IMG_02.IOB is displayed upon playing back 
music #a, IPI#1 in AOBI#l that describes management 

25 information of audio information corresponding to music 

#a designates only IMG_02.IOB. 

Since this still image alone is designated in 
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music #a, still image IMG_02.IOB is automatically set 
as a representative image (or jacket image) for music 
#a. 

In the embodiment shown in FIG. 10, a still image- 
5 to be displayed first for each music number (each tune) 

is automatically set as a representative image (or 
jacket image) for that music number. 

For example, when still images are displayed in 
the order of IMG_04.IOB, IMG_02.IOB, and IMG_03.IOB 
10 during playback of music #P, IMG_04.IOB to be played 

back first upon playback of music #P is set as a 
representative image (which can also be used as a 
jacket image) indicating the contents of music 
Also, still images IMG_04.IOB, IMG_02.IOB, and 
15 IMG_03.IOB can be used as jacket images. 

In the embodiment shown in FIG. 10, music #P is 
made up of three audio information files ATS_02.AOB, 
ATS_03.AOB, and ATS_04.AOB. 

Still image information and text information 
20 associated with this music #P are recorded in 

management information AOBI#2 that pertains to audio 
information file ATS_02.AOB to be played back first in 
this music #p. That is, text information such as a 
song name, singer name, and the like of music #J3 is 
25 recorded in text information #2. 

Also, still image information associated with 
music #P is recorded in the display order of 
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IMG_04.IOB, IMG_02.IOB, and IMG_03.IOB in IPI#2. 

Since still images are displayed in the order of 
IMG_01.IOB and IMG_04.IOB during playback of music #y, 
information that designates these still images is 
5 recorded in IPI#5 in management information A0BI#5 of 

audio information which is played back first in music 
#Y- 

The embodiment shown in FIG. 10 does not have any 
special information for setting representative images 
10 in units of music numbers (in units of tunes), and a 

still image which is displayed first in a given music 
number (given tune) is automatically handled as a 
representative image. 

In the embodiment shown in FIG. 10, a display mode 
15 (see display order setting mode information 51 and 

display timing setting mode information 52 in FIG. 20) 
can be set for each management information (AOBI) # of 
an audio object. However, only the display mode set by 
the display mode information (51, 52) in the first AOBI 
2 0 in a given music number (given tune) is valid. 

When a play list (original play list or user- 
defined play list) is selected, or when specific audio 
information (AOB/TK) is selected, image objects 
(IMG_xx.IOB) corresponding to the selected play list or 
25 audio information can be displayed as jacket images. 

For example, when the user-defined play list shown 
in (a) of FIG. 10 is selected, IMG_01.IOB (personal 
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computer) and IMG_04.IOB (running businessman) can be 
displayed as jacket images on the basis of image 
pointer information IPI#5 of A0BI#5 of music #p. 

On the other hand, when music #a of the original 
5 play list is selected, IMG_02.IOB (bruin) can be 

displayed as a jacket image on the basis of image 
pointer information IPI#1 of A0BI#1 of music #a. 

FIG. 11 shows views for explaining an example of 
the way in which jacket images of respective PGCs are 

10 displayed when audio information with still images 

recorded on the medium according to an embodiment of 
the present invention is played back in units of 
program chains (PGCs) or in units of play lists. 

In the embodiment shown in FIG. 11, not only 

15 representative images (or jacket images) in units of 

music numbers (in units of tunes) but also those in 
units of playback sequences (PGCs) can be set. 

As shown in FIG. 11, both original and user- 
defined PGCs have pieces of PGC general information 

20 1600, 1660, and 1570 that record general information 

which pertains to each PGC, and pieces of text 
information TXI#Z 430, TXI#A 431, and TXI#B 432, and 
IPI 190, IPI 204, and IPI 205 are recorded in each PGC 
general information. 

25 When playback is made in units of playback 

sequences (PGCs), a still image displayed first is 
automatically set as a representative image (or jacket 
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image) of each playback sequence (PGC). 

When the user selects a playback sequence (PGC) to 
be played back, the contents of PGCSI recording region 
140 in (e) of FIG. 5 or 6 are played back to play back 
5 a still image file indicating a representative image of 

each PGC, and text information TXI#Z 430, TXI#A 431 or 
TXI#B 152 shown in (a) of FIG. 11 is superimposed on 
the played-back image and is displayed on the screen, 
as shown in (d) of FIG. 11. 
10 In the embodiment shown in FIG. 11, still image 

file information to be displayed for each music number 
(each tune) is described in IPI#2 in the AOBI (AOBI#2 
in (b) of FIG. 10) to be played back first in a music 
number (e.g., #p in FIG. 10) (it is described in IPI#2 
15 in CI#2 in the embodiment shown in FIG. 12). 

In the example shown in FIG. 11 as well, by 
selecting a play list (original or user-defined one) 
or audio information (AOB/TK), corresponding image 
information (IMG_xx.IOB) can be displayed as a jacket 
20 image. 

FIG. 12 shows views for explaining another example 
of the way in which jacket images of respective music 
numbers (tunes) are displayed when audio information 
with still images recorded on the medium according to 
25 an embodiment of the present invention is played back 

in units of music numbers (tunes) or in units of play 
lists . 
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A method of setting a jacket image will be 
explained first. 

In a method of setting jacket images using pieces 
of image pointer information IPI#1 to IPI#12 (a method 
5 of setting a still image to be displayed first in each 

music number (each tune) as a jacket image, or a method 
of setting a still image set by representative 
image/ jacket image designation flag 71 in units of 
music numbers (tunes) or PGCs, as shown in (d) of 
10 FIG. 20 to be described later), a still image file 

number is directly designated. 

By contrast, in an application example to be 
described below, the numbers of pieces of management 
information 1 to 4 corresponding to still image 
15 information files in IOBSI recording region 142 are 

designated, as shown in (b) of FIG. 12. 

That is, in the data structure shown in FIG. 10, 
still image information displayed upon playing back a 
music number (tune) designated in user-defined PGC 
20 (UD_PGC#A) recording region 151 matches that to be 

displayed upon playing back a music number (tune) 
designated by original PGC (0RG_PGC) information 
recording region 150. 

By contrast, in the data structure shown in 
25 FIG. 12, IPI#11 and IPI#12 in pieces of cell 

information CI#11 and CI#12 defined in UD_PGC#A 
recording region 151 can designate arbitrary still 



57 - 



images, which are not restricted by those to be 
displayed in units of music numbers (tunes) designated 
in ORG_PGC information recording region 150. 

That is, "pieces of management information 1 to 4 
5 corresponding to IMG_xx.IOB" in (b) of FIG. 12 serve as 

conversion files for pointer information (IPI#) that 
designates a still image (IMG_xx. IOB) . 

In the embodiment shown in FIG. 12, number 
information of each of pieces of management information 
10 1 to 9 that pertain to respective lMG_xx.lOB in (b) of 

FIG. 19 is recorded in place of "still image file 
number 72 of the M-th still image to be displayed in a 
music number (tune), PGC, or play list" in (d) of 
FIG. 20. 

15 m the embodiment shown in FIG. 10, still image 

information files ("personal computer" of IMG_01.IOB 
and "running businessman" of IMG_04.IOB) to be 
displayed upon playing back music #P and music #y 
defined in user-defined PGC#A match those ("personal 

20 computer" of IMG_01.IOB and "running businessman" of 

IMG_04.IOB) to be displayed upon playing back music #y 
and music #p defined in the original PGC, and cannot be 
arbitrarily changed. 

By contrast, in the embodiment shown in FIG. 12, 

25 since each cell information CI# has individual image 

pointer information IPI#, still image files to be 
displayed can be set for each CI. 



In the example shown in FIG. 12 as well, by 
selecting a play list (original or user-defined one) or 
audio information (AOB/TK) , corresponding image 
information (IMG_xx.IOB) can be displayed as a jacket 
image . 

FIG. 13 shows views for explaining an example of 
the playback relationship (arrows in FIG. 13) between a 
plurality of music numbers (tunes) stored in the 
information storage medium of FIG. 5 or FIG. 6, and 
text (characters, symbols, figures, and/or marks) 
appended to these music numbers. 

In (a) to (d) of FIG. 13, audio object 
information AOBI# and image pointer information IPI# in 
(c) of FIG. 8 are replaced by text object information 
TOBI# and text pointer information TPI#, and there is 
shown an example of the way in which text information 
to be simultaneously displayed during playback of a 
music number is managed. 

FIG. 14 shows views for explaining another example 
of the playback relationship (arrows in FIG. 14) 
between a plurality of music numbers (tunes) stored in 
the information storage medium of FIG. 5 or FIG. 6, and 
text (characters, symbols, figures, and/or marks) 
appended to these music numbers. 

In (a) to (d) of FIG. 14, image object information 
IOBI# in (c) of FIG. 9 is replaced by text object 
information TOBI#, and there is shown another example 
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of the way in which text information to be 
simultaneously displayed during playback of a music 
number is managed. 

FIG. 15 shows views for explaining still another 
5 example of the playback relationship (arrows in FIG. 

15) between a plurality of music numbers (tunes) stored 
in the information storage medium of FIG. 5 or FIG. 6, 
and text (characters, symbols, figures, and/or marks) 
appended to these music numbers. 

10 In FIG. 15, image pointer information IPI# in 

FIG. 8 is replaced by text pointer information TPI#, 
and there is shown still another example of the way in 
which text information to be simultaneously displayed 
during playback of a music number is managed. 

15 FIG. 16 shows views for explaining the data 

structure of an image object set information 
(IOBSI.IFO) file recorded on the information storage 
medium according to an embodiment of the present 
invention . 

20 FIG. 17 shows views for explaining the data 

structure of management information (26*) of still 
image ID information in the image object set 
information (IOBSI.IFO) file shown in FIG. 16. 

In the embodiment of the present invention, ID 

25 information (xx of IMG_xx.IOB; xx = 01 to 52 in the 

example shown in FIG. 17) is appended to each still 
image information (IMG_01.IOB to IMG_52.IOB), as shown 



60 - 



in (d) of FIG. 17, and management information 26* (2- 
bit flag) indicating if given ID information 
(IMG_xx.IOB) is used ("01") or unused ("00") is 
provided, as shown in (e) of FIG. 16 and (b), (c) of 
5 FIG. 17. 

Since this flag consists of 2 bits, four different 
states can be discriminated. For example, if flag = 
00b, it indicates "unrecorded" (absence of still image 
data); if flag = 01b, it indicates "recorded No. 1" 
10 (presence of still image data) ; if flag = 10b, it 

indicates " recorded No. 2" (presence of image data 
with text such as words or the like); and if flag = 
lib, it indicates "recorded No. 3" (presence of motion 
JPEG data obtained by, e.g., continuous shots (a 
15 maximum of 20 images per music number or per tune) or 

the like of a digital camera), thus allowing four 
different ways of flag identification. 

In the embodiment of the present invention, each 
still image information (IOB) is recorded as an 
20 independent file. As a file extension of such still 

image information (IOB), "IOB" is used. 

In the embodiment of the present invention, an 
independent file name (xx of lMG_xx.IOB) is set for 
each still image information (IOB) as ID information 
25 used to identify each still image information (IOB). 

To allow easy ID information management, a number such 
as "IMG_xx" or the like is assigned as an independent 



file name, and a number (xx) assigned to this file name 
is managed as ID Information used to identify each 
still image information (IOB). 

Management information as to whether or not unique 
5 ID information is assigned is recorded as "management 

information 26* of still image ID information" in IOB 
bitmap information 12 as configuration information of 
IOBSI management information 10 in IOBSI.IFO file 2130, 
as shown in FIG. 16. 
10 IOBSI.IFO file 2130 that contains management 

information as to whether or not unique ID Information 
is assigned is allocated under real-time audio 
recording directory 2100, as shown in FIG. 7, and is 
physically recorded in IOBSI recording region 142 in 
15 (e) of FIG. 5. 

In the embodiment of the present invention, a 
maximum of 999 still image files as still image 
information (IOB) can be recorded in the information 
storage medium such as audio card 100 with the copy 
2 0 protection function shown in (a) of FIG. 5. 

A major characteristic feature of the embodiment 
of the present invention lies in that fields for 
recording still image information (IOB) for a maximum 
of 999 images are set in advance, and the information 
25 description field size (data size) for each still image 

information (IOB) is a fixed length, as shown in (b) or 
(e) of FIG. 16. 
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With this data structure, the start address of 
each information in IOBSI.IFO file 2130 (for example, 
the start address of management information 2 that 
pertains to IMG_02.IOB, and the address of 
5 recorded/unrecorded flag 45 for IMG_05.IOB) remains 

unchanged even by new recording/a change in information 
contents /deletion of each still image information 
(IOB). 

As a result, since the start address of each 

10 information is predetermined even by repeating new 

recording/a change in information contents /deletion of 
each still image information (IOB), system controller 
3020 of the information recording/playback apparatus 
shown in FIG. 23 need only read only required 

15 information in IOBSI.IFO file 2130. That is, since a 

buffer memory (not shown) of system controller 3020 
need only temporarily save minimum required 
information, the buffer memory size can be saved. 

For this reason, the buffer memory size in system 

2 0 controller 3020 can be small, and the information 

recording/playback apparatus shown in FIG. 23 can be 
manufactured with relatively low cost. 

Also, according to the embodiment of the present 
invention, since the start address of each information 

25 is predetermined, system controller 3020 in the 

information recording/playback apparatus in FIG. 23 can 
directly access the required position (address) in 
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IOBSI.IFO file 2130. Hence, simple, high-speed access 
can be attained. 

Recorded/unrecorded flags 41* to 49* for 
IMG_xx.IOB are set to have 2 bits each. 
5 a "01" flag is set for "ID number IMG_xx" assigned 

to a still image file recorded in IOB recording region 
132 in the information storage medium shown in (d) of 
FIG. 5, and a "00" flag is set for "ID number IMG_xx" 
which is not assigned to a recorded still image file 
10 yet. 

A practical setting method of the flags will be 
explained below using FIG. 17. 

When still image files IMG_01.IOB, IMG_03.IOB, 
IMG_0 5 . IOB , IMG_0 7 . IOB , IMG_0 8 . IOB , . . . , IMG_5 1 . IOB , and 
15 IMG_52.IOB are recorded in the information storage 

medium, as shown in (d) of FIG. 17, the contents of 
recorded/unrecorded flags 41* to 49* corresponding to 
these IMG_xx.IOB are as shown in (c) of FIG. 17. 

In (d) of FIG. 17, since still image files 
20 IMG_02.IOB and IMG_04.IOB are unrecorded, flags 42* and 

44* corresponding to these files assume a value "00", 
as shown in (c) of FIG. 17. 

Also, in (d) of FIG. 17, since still image files 
are recorded up to IMG_52.I0B, the contents of "final 
25 number information 22 of recorded still image (IOB) 

files" in (a) of FIG. 17 are "52". 

A sequence for recording new still image 
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information (IOB) in the information storage medium 
using the apparatus shown in FIG. 23 is as follows. 

<01> The number of pieces of still image 
information to be recorded and attribute information 
5 (see (c) and (d) of FIG. 19) such as a resolution, 

compression method, and the like are input at data 
input PC 3640 in FIG. 23 via inter-PC data I/F 
processor 3540. 

<02> System controller 3020 issues an instruction 
10 to information recorder /player 3000 to play back 

IOBSI.IFO file 2130 (FIG. 7) recorded in IOBSI 
recording region 142 in (e) of FIG. 5 and to 
temporarily save it in its internal buffer memory 
(not shown) . 

15 <03> System controller 3020 plays back final 

number information 22 of still image (IOB) files 
recorded in IOBSI.IFO file 2130 temporarily saved in 
the buffer memory. 

<04> System controller 3020 plays back 

20 information of "recorded/unrecorded flags 41* to 49*" 

for lMG_xx.IOB in (b) of FIG. 17 recorded in IOBSI.IFO 
file 2130 temporarily saved in the buffer memory from 
the first number to the number ("52" in the example in 
(d) of FIG. 17) set by "final number information 22" 

25 read in <03> above. System controller 3020 then 

searches for unrecorded ID numbers with flags = "00" in 
(c) of FIG. 17 from the read number range (from IMG_01 
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to IMG_52) . 

In the embodiment of the present invention, since 
the start address of each information is predetermined, 
the unrecorded ID number search process need only play 
back required information. 

<05> System controller 3020 records each still 
image information (IOB) input via inter-PC data I/F 
processor 3540 in the information storage medium 
(memory card 100) while setting the number of a still 
image file name in accordance with the ID number 
(IMG_xx with flag "00") extracted in <04> above. 

At this time, the operation of information 
recorder /player 3000 is controlled by system controller 
3020. 

<06> Upon completion of recording of still image 
information (IOB), system controller 3020 changes the 
contents of IOBSI management information 10 ((b) of 
FIG. 16) in IOBSI. IFO file 2130 temporarily saved in 
the buffer memory. 

<07> System controller 3020 records information 
such as a resolution, compression method, and the like 
of still image information input in <01> above in still 
image attribute information 431 ((c) of FIG. 19) 
temporarily saved in the buffer memory. 

In the embodiment of the present invention, since 
the start address of each information is predetermined, 
pieces of management information 1 to 9 associated with 
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IMG_xx.IOB to be recorded can be directly accessed and 
recorded. For this reason, a recording process is very- 
easy, and can be executed at high speed. 

<08> When the number item of music number (or a 
5 tune number) for displaying each still image 

information recorded in the information storage medium 
is designated at data input PC 3640, system controller 
3020 issues an instruction to information 
recorder /player 3000 to read out information of image 
10 pointer information IPI# (IPI#1 to IPI#5 and the like 

in (c) of FIG. 8) in AOBI# corresponding to the 
designated music number, change the contents of readout 
IPI#, and then record IPI# on the information storage 
medium again. 

15 <09> At this time, when a new representative 

image is set, system controller 3020 changes 
information of "bitmap information 27 of a still image 
(IOB) file designated as a representative image" ((d) 
of FIG. 16) in IOBSI . IFO file 2130 temporarily saved in 

20 the buffer memory. 

<10> Upon completion of changes in data of 
IOBSI. IFO file 2130 temporarily saved in the buffer 
memory of system controller 3020, system controller 
3020 issues an instruction to information 

25 recorder /player 3000 to write back IOBSI. IFO file 2130 

in the buffer memory to the information storage medium. 
A method of generating a list of still image files 



recorded on the information storage medium in the 
embodiment of the present invention will be explained 
below. 

For example, when a music number (tune) to which 
5 still image information recorded on the information 

storage medium is attached is set using a PC, 
information of this "still image file list" is 
required. 

In the conventional method, after all IMG_xx.IOB 

10 files shown in FIG. 16 are collected using file system 

drive software such as FAT, UDF, or the like, their 
file names are read, and the relationship between these 
file names and IOBSI.IFO file 2130 must be checked, 
resulting in complicated, much time-consuming list 

15 generation. 

By contrast, in the embodiment of the present 
invention, since only a simple process to be described 
below is required, the still image file list can be 
generated at high speed. 

20 <21> The user issues a generation instruction of 

the still image file list recorded on the information 
storage medium. 

<22> System controller 3020 issues an instruction 
to information recorder/player 3000 to play back 

2 5 IOBSI.IFO file 2130 (FIG. 16, FIG. 7) recorded in IOBSI 

recording region 142 in (e) of FIG. 5 and temporarily 
save played back information in its internal buffer 
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memory (not shown). 

<2 3> System controller 3020 reads "management 
information 26* of still image ID information" ((d) of 
FIG. 16) in the buffer memory, and displays a list of 
5 already recorded still image file numbers on image 

display 3710 in FIG. 23. 

Since the already recorded still image file 
numbers are known, it is easy to display each still 
image . 

10 When attributes of each still image must be 

displayed at the same time, 

<24> system controller 3020 directly accesses 
required "attribute information 431 of a still image" 
((c) of FIG. 19) in the buffer memory, and displays it 

15 simultaneously. 

In the embodiment of the present invention, since 
the start address of each information is predetermined, 
pieces of management information 1 to 9 associated with 
IMG_xx.IOB to be recorded can be directly accessed and 

20 recorded. For this reason, a recording process is very 

easy, and can be executed at high speed. 

FIG. 18 shows views for explaining the data 
structure of bitmap information (27) of a still image 
file designated as a representative image or jacket 

25 image in image object set information (I0BSI.IFO) in 

FIG. 16. 

FIG. 19 shows views for explaining the data 
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structure of management information that pertains to 
each image object (IMG_xx.IOB) in the image object set 
information (IOBSI.IFO) in FIG. 16. 

The data structure in IOBSI.IFO file 2130 will be 
5 explained below with reference to FIGS. 18 and 19. 

As shown in (b) of FIG. 18 or 19, IOBSI.IFO file 
2130 is made up of IOBSI management information 10 that 
records general information which pertains to all 
pieces of still image information, and pieces of 
10 management information 1 to 9 that pertain to 

IMG_01.IOB to IMG_999.IOB. 

Note that the data size of IOBSI management 
information 10 and that of each of pieces of management 
information 1 to 9 that pertain to IMG_01.IOB to 
15 IMG_999.IOB are fixed sizes. Since the fixed data size 

is used, an access destination upon recording/playback 
of management information that pertains to each still 
image can be detected in advance. 

For example, when management information that 
20 pertains to IMG_02.IOB is played back, an address 

obtained by adding the data sizes of IOBSI management 
information 10 and management information 1 that 
pertains to IMG_01.IOB, which are predetermined, can be 
accessed. 

2 5 IOBSI management information 10 has image object 

set general information I0BS_GI11 that records general 
information of still images, and information 11 records 
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the total number 21 of still image files (that matches 
the number of still images) recorded in IOB recording 
region 132 in the information storage medium (audio 
card 100 with the copy protection function or disc- 
5 shaped information storage medium 170), and final 

number information 22 of the recorded still image (IOB) 
files. 

Also, IOBSI management information 10 includes 
IOBS bitmap information 12 that records bitmap 

10 information pertaining to all still images. 

As an example of contents of bitmap information 2 7 
of a still image (IOB) file designated as a 
representative image (or jacket image), representative 
image designation flags 31 to 39 are stored. 

15 These flags are assigned to IMG_01.IOB file by 2 

bits, IMG_02.IOB file by 2 bits,..., i.e., a 2-bit flag 
is assigned to each file, and a flag other than "00" is 
set in a still image file that stores a still image 
designated as a representative image (or jacket image) 

20 of the still image files ("00" is set in a still image 

file which stores a still image which is not designated 
as a representative or jacket image). 

Since this flag consists of 2 bits, four different 
states can be discriminated. For example, if flag = 

25 00b, it indicates "no designation" (normal still 

image); if flag = 01b, it indicates "representative 
image designation"; if flag = 10b, it indicates "jacket 
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image designation"; and if flag = lib, it indicates 
"other image designation", thus allowing four different 
ways of flag identification. As an example of other 
image designation, simultaneous designation of both the 
5 representative and jacket images can be made. 

Note that IMG_xx.IOB in (e) of FIG. 18 can contain 
text information (in, e.g., a bitmap format) that 
describes the words, profiles of an artist, recording 
data, and the like of the music number (tune) of 

10 interest, as needed. 

Each of pieces of management information 1 to 9 
that pertain to respective still image files is made up 
of still image attribute information 431 and 
designation state information 432 of a representative 

15 image (or jacket image), as shown in (d) of FIG. 19. 

Still image attribute information 431 includes 
compression method/compression version information 441 
of a still image, resolution information 422 of a still 
image, and recorded/unrecorded flag 41* for the 

20 corresponding image data. 

Compression method/compression version information 
441 records a compression method such as JPEG, MPEG (I- 
picture), or the like and its version information. 
Resolution information 442 records resolution 

25 information of the corresponding image data. 

Recorded/unrecorded flag 41* records 
recorded/unrecorded flag (2-bit flag indicating the 
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presence/absence of still image data) 41* for 
corresponding image data (IMG_01.IOB in this case). An 
information file that pertains to this 
recorded/unrecorded flag 41* can be recorded together 
5 in subdirectory 2400 in FIG. 7. 

On the other hand, representative image 
designation state information 432 records information 
450 of the number of music numbers (the number of 
tunes) that designate the still image of interest as a 

10 representative image (or jacket image), and N "music 

number /tune number, AOBI number, or CI number that 
designates the still image of interest as the first 
representative image (or jacket image)" 451,..., 452 (N 
is a positive fixed value). 

15 Note that the upper limit value of the number item 

of music numbers (number of tunes) or the number of 
audio information files that can set for given still 
image information as a representative image (or jacket 
image) is N. N is equal to or smaller than a maximum 

20 of 999, and is preferably 10 or less in practice (to 

reduce the load of management). 

As shown in (d) of FIG. 19, representative image 
designation state information 432 has description 
fields up to music number /tune number or AOBI number /CI 

25 number 452 that designates the still image of interest 

as the N-th representative image (or jacket image). 
Numbers are filled in turn from music number/tune 
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number or AOBI number/CI number 451 that designates the 
still image of interest as the first representative 
image (or jacket image) in accordance with information 
450 indicating the number item of music numbers (number 
5 of tunes) that designate the still image of interest as 

a representative image (or jacket image), and the 
remaining fields are set at "0". 

Note that the data structure in the IOBSI.IFO file 
2130 shown in FIG. 18 or FIG. 19 can be applied not 

10 only to that shown in FIG. 10 or FIG. 11, but also to 

the data structure shown in FIG. 12. 

FIG. 20 shows views for explaining the data 
structure of image pointer information (IPI) shown in 
FIGS. 1 to 4, and FIGS. 10 to 12, and the like. 

15 Image pointer information 40 (corresponding to IPI 

in FIGS. 1 to 4 and FIGS. 8 to 12) in (a) of FIG. 20 
records still image display mode information 43 (51, 
52) and still image designation information 47 in units 
of music numbers (tunes), in units of PGCs, or in units 

20 of play lists. 

As shown in (c) of FIG. 20, display mode 
information 43 includes mode information 51 for setting 
the display order of still images, and mode information 
52 for setting the display timings of still images. 

25 The still image display order setting mode 

information 51 has contents for designating a 
"sequential mode" for displaying images in turn in 
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accordance with the designated playback order, a 
" random/ shuf f le mode" for randomly displaying 
designated still images, a "browse mode" for switching 
a still image to be displayed at the input timing of 
5 the user (to allow the user to review a plurality of 

still images). 

Still image display timing setting mode 
information 52 has contents for setting the display 
timings of one or more still images set in a music 

10 number (tune) in synchronism with divisions of audio 

frames of an AOB managed by, e.g., AOBI (TKI). 

In this embodiment, a maximum of M still images 
can be displayed in units of music numbers (tunes) or 
in units of PGCs . M is a fixed value, which is 

15 selected from a range from 5 to 100 images, and is 

preferably around 20. 

The data size of image pointer information (IPI) 
40 is always fixed, and fields are initially set from 
the description field of still image 61 to be displayed 

20 first to that of information 69 of a still image to be 

displayed as the M-th image, as shown in (c) of FIG. 
20. 

In the description field of still image 61 to that 
of information 69 to be displayed as the M-th image, 
25 file numbers (e.g., "02" in case of IMG_02.IOB) 72 of 

still image files designated by IPI 40 are recorded in 
the display order. 
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When the number of designated still image files is 
small, "0" is recorded in the remaining fields. For 
example, in case of IPI 40 that does not designate any 
still image files at all, "0" is recorded from the 
5 description field of still image 61 to be displayed 

first to that of information 69 of a still image to be 
displayed as the M-th image. 

Information indicating the number of still images 
designated for each IPI 40 is recorded in the number 60 
10 of still images to be displayed in units of music 

numbers (tunes), PGCs, or play lists shown in (c) of 
FIG. 20. 

By playing back this information, description 
fields from the description field of still image 61 to 
15 be displayed first to that of information 69 of a still 

image to be displayed as the M-th image, which record 
"designated still image file number information" can be 
detected. 

In this embodiment, a still image stored in a 
20 still image file corresponding to still image file 

number 72 designated in "information 61 of a still 
image to be displayed first" shown in (c) of FIG. 20 
serves as a representative image (or jacket image). 

However, the present invention is not limited to 
25 this. For example, the first 1 or 2 bits of pieces of 

information 61 to 69 of still images to be displayed in 
turn are assigned to designation flag 71 of a 
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representative image (or jacket image) in units of 
music numbers (tunes), PGCs, or play lists, as shown in 
(d) of FIG. 20. Then, a still image stored in a still 
image file number with this 1- or 2-bit flag = "1" or 
5 "01" can be set as a representative image (or jacket 

image) . 

With this method, a still image other than a 
"still image to be displayed first" in units of music 
numbers (tunes), PGCs, or play lists can be set as a 

10 representative image (or jacket image). 

FIG. 21 is a view for explaining the playback 
relationship (broken arrows in FIG. 21) between a 
plurality of music numbers (tunes) and still images 
(that can include jacket images, word card images, and 

15 the like) appended to these music numbers when cell 

information (CI#) in FIG. 10, etc. is changed to read a 
track search pointer (DPL_TK_SRP# ) , audio object 
information (AOBI#) in FIG. 10, etc. is changed to read 
track information (TKI#), and image pointer information 

20 (IPI#) in FIG. 10, etc. is changed to read a track 

information search pointer (TKI_IOB_SRP ) for an image 
object. 

By changing certain terms as follows (changes of 
terms), the playback relationship mentioned above with 
25 reference to FIGS. 8 to 10, etc. can be applied to FIG. 

21: 

* PGC set information -» play list manager PLM; 



* original PGC -> default play list DPL; 

* individual user-defined PGC -> individual play 
list PL; 

* cell information CI -> track search pointer 
5 DPL_TK_SRP of default play list; 

* audio object information AOBI — » track 
information TKI; 

* cell information CI -> track information TKI; 

* image pointer information IPI — > track 

10 information image object search pointer TKI_IOB_SRP ; 

and 

* time map information TMI -» time search table 
TMSRT . 

In the structure shown in FIG. 21, when music #(3 
15 is a long one, an AOB file of music #{3 may be 

automatically segmented in units of specific times, and 
track information TKI (corresponding to AOBI or CI) may 
be appended to the segmented AOB files. 

In this case, AOB file numbers after segmentation 
2 0 are assigned in correspondence with the numbers of 

assigned TKIs. 

Only the first TKI of each music number (each 
tune) is designated by each user-defined play list PL 
in place of default play list DPL. In this case, still 
25 images displayed in units of music numbers (tunes) are 

designated by the first TKI of each music number. 

In the example shown in FIG. 21, an unrecorded 
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region or unused region is assured in correspondence 
with the contents of default play list DPL or track 
manager TKM (management information). 

Since an unrecorded region (unused region) can be 
5 set in management information in this manner, even when 

a portion of the management information is deleted by, 
e.g., editing, other portions of the management 
information need not be modified, thus allowing simple 
handling of the management information. 

10 Furthermore, the size of each TKM (management 

information) including an unused region is fixed (e.g., 
at 1,536 bytes), management of the recording location 
(address) of each TKM (management information) can also 
be simplified. 

15 In this way, the buffer memory size of the 

playback apparatus required for the management 
information (the size of the internal buffer (not 
shown) of, e.g., information recorder/player 3000 in 
the apparatus shown in FIG. 23) can be greatly reduced. 

20 In the aforementioned structure, display mode 

information 43 (51, 52) in FIG. 20 is provided to each 
music number (each tune). If a music number includes a 
plurality of pieces of TKI (AOBI), only the display 
mode information included in image pointer information 

25 (IPI 40 in FIG. 20) of the first TKI (AOBI) of that 

music number is handled as a valid one that can 
designate the display order (display sequence) and/or 
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display timings of still images of that music number. 

FIG. 22 shows views for explaining an example of 
the format (data structure) when encrypted audio 
information is recorded on the audio card with the copy 
5 protection function shown in FIG. 5. 

The data structure in audio object file 2500 ((a) 
of FIG. 22) in the embodiment of the present invention 
will be explained below. 

Audio information (audio object AOB) is made up 
10 of audio object units AOBU 2510 to AOBU 2530 ((b) of 

FIG. 22). 

Each of these AOBU 2510 to AOBU 2530 is formed by: 

(01) segmenting information into units each 
having a specific data size (32-kbyte unit, 16-kbyte 

15 unit, 5 12 -kbyte unit, or the like); 

(02) segmenting information into units at 
specific audio frame counts; or 

(03) segmenting information into units at 
playback time units (0.2-sec unit, 1-sec unit, 2-sec 

20 unit, 5-sec unit, 10-sec unit, or the like). 

In the embodiment of the present invention, 
compression of audio information uses AAC (advanced 
audio coding) of MPEG. 

As shown in (c) of FIG. 22, audio object file 2500 
25 is formed of a set of a plurality of audio frames 2610 

to 2630. 

Since the number of audio frames included in each 
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audio object file 2500 is described in audio object 
information AOBI in (c) of FIG. 8, the "total number of 
frames of each music number (each tune)" can be 
obtained using relationship information with music 
5 numbers (tunes) described in cell information CI. 

The information of the "total number of frames of 
each music number (each tune)" is recorded in audio 
object information (e.g., AOBI#2 in music #P) 
corresponding to an audio information file to be played 

10 back first in the music number. 

In AAC, each of audio frames (AOB frames) 2610 to 
2630 ((c) of FIG. 22) is formed of ADTS (advanced audio 
coding transport stream, or audio data transport 
stream) header 2710, and audio information recording 

15 region 2740 ((d) of FIG. 22). 

ADTS header 2710 includes fixed header 2720 
including a sync word of an AOB, and variable header 
2730 ( (d) of FIG. 22 ) . 

in an encryption method of audio information 

20 (AOB), as shown in (e) of FIG. 22, ADTS header 2710 is 

set as non-encrypted region 2810 (a plane state without 
encryption), and compressed audio information recording 
region 274 0 is encrypted every encryption unit (#a to 
#f) in turn from its head position. 

25 For example, data in each encryption unit (#a to 

#f ) undergoes an arithmetic process in accordance with 
a cipher key (encryption key) generated based on a 
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random number, and that arithmetic operation result is 
recorded as encrypted information. 

Encryption is done within each encryption unit (#a 
to #f), and the arithmetic process based on the cipher 
5 key (encryption key) repeats itself every encryption 

unit (#a to #f ) . 

In the embodiment of the present invention, each 
encryption unit (#a to #f) has a 64- or 56-bit unit. 
The size of compressed audio information recording 
10 region 2740 does not always match an integer multiple 

of 64 bits. Hence, only region "g" as the remainder 
(fraction part) obtained by dividing compressed audio 
information recording region 2740 by an integer 
multiple of the encryption unit is held in a non- 
15 encrypted, plane state. 

That is, non-encrypted region "g" is assured as a 
kind of padding region to match the size of compressed 
audio information recording region 2740 with an integer 
multiple of 64 bits. 
20 FIG. 23 is a block diagram for explaining an 

example of the arrangement for recording information or 
playing back information on or from the audio card with 
the copy protection function shown in FIG. 5. 

FIG. 24 is a flow chart for explaining the 
25 sequence of a mutual authentication process and cipher 

key (encryption key) exchange process done between the 
audio card in FIG. 5 (or optical disc shown in FIG. 6), 
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and the recording/playback apparatus shown in FIG. 23. 

The arrangement of a recording system capable of 
writing information (audio information and/or still 
image information) to be copy-protected in audio card 
5 (memory card) 100 will be explained first. 

As a popular device that digitally records still 
image information which can be handled by the apparatus 
in FIG. 23, a digital camera is known. Still image 
information to be digitally recorded is also used as a 
10 menu image in DVD video that digitally records /plays 

back moving picture information (I-picture of MPEG can 
be considered as still image information) in addition 
to the digital camera. 

As means for inputting such still image 
15 information to the apparatus shown in FIG. 23, 

(11) video capture unit 3510 captures a video 
signal from CCD camera 3610 or TV tuner 3620 to convert 
it into a still image, and an A/D converter (not shown) 
built in video capture unit 3510 converts the captured 

20 still image into a digital signal and inputs the 

digital signal to input data transfer destination 
switching unit (data bus line) 3210; 

(12) still image information sensed by digital 
camera 3630 is sent to I/F processor 3520 of the 

25 digital camera using a serial transmission line such as 

RS-232C or the like, and is input to input data 
transfer destination switching unit 3210; 
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(13) still image information created using 
personal computer (PC) 3640 or still image information 
scanned by an image scanner connected to this PC is 
input to input data transfer destination switching unit 
5 3210 via inter-PC data I/F processor 3540; and so 

forth. 

As means for inputting text information to the 
apparatus shown in FIG. 23, 

{14) key input data from a keyboard is input to 
10 input data transfer destination switching unit 3210; 

(15) character selection/designation is made 
using dial rotation/dial in used in, e.g., a digital 
camcorder to input character codes of JIS, ASCII, or 
the like to input data transfer destination switching 

15 unit 3210; and so forth. 

Furthermore, as means for inputting audio 
information to the apparatus shown in FIG. 23, 

(16) an analog audio signal (e.g., an analog 
playback output of a CD player) externally input via 

20 analog input terminal 3570 is converted into a digital 

signal by DAC 3350, the digital signal undergoes, e.g., 
MPEG2/AAC compression coding by audio encoder 3310, and 
the compressed digital signal is input to input data 
transfer destination switching unit 3210 (whether or 

25 not compression is done by audio encoder 3310, the 

compression method to be used if compression is done, 
and so forth can be determined in accordance with an 
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instruction from system controller 3020); 

(17) an analog audio signal input from audio 
input microphone 3650 via microphone input terminal 
3560 is converted into a digital signal by DAC 3350, 

5 the digital signal undergoes MPEG2/AAC compression 

coding by audio encoder 3310, and the compressed 
digital signal is input to input data transfer 
destination switching unit 3210; 

(18) a digital audio signal (e.g., a linear PCM 
10 digital output from a CD player) externally input via 

digital input terminal 3580 undergoes MPEG2/AAC 
compression coding by audio encoder 3310, and the 
compressed digital signal is input to input data 
transfer destination switching unit 3210; 

15 (19) already compressed digital audio information 

is directly fetched by data input PC 3640 from a WWW 
(World Wide Web), the Internet, and the like via a 
modem (not shown). The digital audio information is 
input to input data transfer destination switching unit 

20 3210 via inter-PC data I/F processor 3540; and so 

forth. 

Desired ones (e.g., JPEG-compressed still image 
information from digital camera 3630 and MPEG- 
compressed audio information from audio encoder 3310) 
25 of various kinds of digital information input by the 

aforementioned methods are selected under the control 
of system controller 3020. The selected information 
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( JPEG-compressed still image information and MPEG- 
compressed audio information) is transferred to 
information recorder /player 3000 via input data 
transfer destination switching unit (data bus line) 
5 3210. 

Note that audio input information or still image 
information transferred to information recorder/player 
3000 is sometimes appended with information of analog 
copy generation management system CGMS-A when it is an 

10 analog input signal or information of digital copy 

generation management system CGMS-D when it is a 
digital input signal. 

When "copy freely" information (2-bit flag) is 
described as the information of copy generation 

15 management system CGMS, since no encryption is 

required, non-encrypted, plane input information is 
transferred from input data transfer destination 
switching unit 3210 to information recorder /player 
3000. 

20 On the other hand, when CGMS-A or CGMS-D 

designates copy restriction, copy- restricted 
information is transferred from input data transfer 
destination switching unit 3210 to encryption processor 
3110. 

25 Encryption processor 3110 encrypts the copy- 

restricted information on the basis of a cipher key 
(encryption key) randomly generated by cipher key 
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{encryption key) generation/saving unit 3140 (see (e) 
of FIG. 22 for the encryption method) . 

Audio information and/or still image information 
encrypted by encryption processor 3110 are/is sent to 
5 mutual authentication/key exchange & encrypted 

information I/F controller 3120. 

Mutual authentication/key exchange & encrypted 
information I/F controller 3120 transfers the encrypted 
audio information and/or still image information to 

10 information recorder/player 3000. The information to 

be transferred to information recorder /player 3000 is 
appended with copy restriction information (2 -bit flag) 
of CGMS-A or CGMS-D as needed. 

When "copy once" information is described as CGMS 

15 information, the encrypted audio input information is 

transferred from mutual authentication/key exchange & 
encrypted information I/F controller 3120 to 
information recorder /player 3 000 together with this 
CGMS information while being appended with a decryption 

20 key. 

When "copy never" information is described as CGMS 
information, the encrypted audio input information is 
transferred from mutual authentication/key exchange & 
encrypted information I/F controller 3120 to 
25 information recorder /player 3000 together with this 

CGMS information without any decryption key. 

Alternatively, when "copy never" information is 
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described as CGMS information, only a warning message 
"this program is copyrighted and cannot be recorded" 
may be transferred from mutual authentication/key 
exchange & encrypted information I/F controller 3120 to 
5 information recorder/player 3000, so as to inhibit 

recording other than this warning. 

The CGMS information (a 2-bit flag indicating the 
type of copy restriction or a warning message of 
copyright protection) can be written in, e.g., card 
10 unique ID & key information recording region (RAM) 103 

in audio card (memory card) 100 shown in (a) of FIG. 5. 

Alternatively, the CGMS information (a 2-bit flag 
indicating the type of copy restriction or a warning 
message of copyright protection) can be written in a 
15 rewritable data zone of lead-in area 1800 or management 

information recording region 130 in (d) of FIG. 6 in 
optical disc 170 shown in (a) of FIG. 6. 

The operations of the aforementioned encryption 
related units (3110 to 3140) (selective encryption 
20 depending on the contents of CGMS information) are 

controlled by system controller 3020. 

More specifically, information recorder /player 
3000 includes: 

(21) a contact electrode section when the 

25 information storage medium is audio card (memory card) 

100; 

(22) a magnetic head in an HDD and HDD rotation 
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control circuit when the information storage medium is 
a removable hard disk; 

(23) an optical head and disc rotation control 
circuit when the information storage medium is a 
5 recordable /reproducible optical disc; and the like 

(FIG. 23 exemplifies a case wherein memory card 100 is 
used) . 

A description of the arrangement in FIG. 23 will 
continue assuming that audio information and/or still 
10 image information, which are/is copy-managed by CGMS, 

are/is recorded/played back on/from audio card (memory 
card) 100. 

At the same time, a mutual authentication & key 
exchange process between audio card (memory card) 100 
15 and the apparatus in FIG. 23 will be parallel explained 

with reference to FIG. 24. 

When audio card (memory card) 100 is loaded into 
information recorder /player 3000 in FIG. 23 (by the 
user), card 100 is powered from the information 
20 recorder/player 3000 side via electrodes (not shown) of 

the card. Control CPU/MPU 101 in card 100 then 
launches an authentication/key exchange & I/O process 
related program stored in ROM 102 in (a) of FIG. 5. 

With this program, mutual authentication and key 
25 exchange are executed between encryption processing 

unit 3010 and audio card 100. 

That is, in the authentication/key exchange 
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process, cipher key (encryption key) generation/saving 
unit 3140 generates a challenge key, which is encrypted 
by encryption processor 3110, and the encrypted key is 
sent to audio card 100 via mutual authentication /key 
5 exchange & encrypted information I/F controller 3120. 

Then, audio card 100 decrypts the encrypted challenge 
key to execute authentication. 

Furthermore, a response key saved in card unique 
ID information & key information recording region (RAM) 

10 103 is encrypted and is sent to encryption processing 

unit 3010, which decrypts the encrypted response key to 
execute authentication . 

In these authentication processes, each other's 
IDs are checked. 

15 For example, CPU/MPU 101 in card 100 in (a) of 

FIG. 5 reads the unique ID (this ID is written in, 
e.g., a ROM (not shown) in information recorder /player 
3000) of the apparatus in FIG. 23 via information 
recorder /player 3000, and can check if that apparatus 

20 is an authentic one which matches itself (card 100). 

Likewise, system controller 3020 in FIG. 23 reads 
the unique ID of card 100 in (a) of FIG. 5 via 
information recorder/player 3000, and can check if that 
apparatus is an authentic one which matches itself 

25 (apparatus in FIG. 23). 

In this manner, mutual authentication is done 
between card 100 and the apparatus shown in FIG. 23 
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(step ST10) . 

If mutual authentication has failed, the 
subsequent processes are canceled (not shown in 
FIG. 24), and information recording/playback on/ from 
5 card 100 is inhibited. 

If mutual authentication has succeeded, a common 
cipher key (encryption key) is generated based on a 
random number or the like between audio card 100 and 
encryption processing unit 3010, and the common cipher 
10 key (encryption key) information is temporarily saved 

in both card unique ID information & key information 
recording region (RAM) 103 and cipher key (encryption 
key) generation/ saving unit 3140 (step ST12). 

In this way, both card 100 and the apparatus in 
15 FIG. 23 have common key information required for 

decryption. 

Upon completion of a series of mutual 
authentication/key exchange processes, encryption 
processor 3110 encrypts digital information (audio 
20 information or image information) sent from input data 

transfer destination switching unit 3210 using the 
common cipher key (encryption key) generated by the 
aforementioned processes (step ST14). 

In this encryption, encryption conversion (for 
25 randomly shuffling data in encryption units) is done 

every encryption unit (64 bits) for compressed audio 
information recording region 2740 shown in (d) and (e) 
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of FIG. 22, thus rewriting data. 

in this case, ADTS header 2710 and fraction region 
" g" do not undergo encryption conversion, and are 
transferred to information recorder /player 3000 in a 
5 non-encrypted, plane state. 

The encrypted digital information is transferred 
to card 100, and is recorded at a predetermined 
location of data region 113 of card 100 (upon recording 
in step ST16) . 

10 When information to be copyright-protected is 

recorded on card 100, information of CGMS-D is 
transferred and recorded at the same time. 

On the other hand, upon playback of encrypted 
information, data (audio information or image 

15 information) that has undergone encryption conversion 

in encryption units, and non-encrypted ADTS header 2710 
and region "g" are transferred from card 100 to 
encryption processing unit 3010 via information 
recorder/player 3000 (upon playback in step ST16). 

20 The transferred encryption-converted data is 

decrypted by decryption processor 3130 (step ST18), and 
decrypted data is output to output data/control 
information transfer destination switching unit 
(data/command bus line) 3220. 

25 Note that the encryption-converted data includes 

CGMS-D information if it is copyright-protected. 

An example of the process upon playback will be 
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explained in more detail below. 

When information recorded on audio card 100 with 
the copy protection function is to be played back, 
information recorder /player 3000 reads information in 
5 program chain set information recording region 140 

shown in (e) of FIG. 5, stores at least a portion of 
the read information in the internal memory (RAM) of 
system controller 3020, and searches for an audio 
information file to be played back using the 

10 information temporarily saved in the memory. 

Before playback of an audio information file, 
system controller 3020 reads CGMS-D information which 
pertains to that information, and determines whether 
the information is transferred to output data/control 

15 information transfer destination switching unit 3220 

directly or via encryption processing unit 3010, thus 
selecting one of these transfer routes. 

When encrypted information is transferred from 
information recorder/player 3000, the mutual 

20 authentication/key exchange processes in steps ST10 to 

ST12 in FIG. 24 are executed, and a common cipher key 
(encryption key) is held between encryption processing 
unit 3010 and audio card 100. 

The encrypted information input to decryption 

25 (decipher) processor 3130 via mutual authentication/key 

exchange & encrypted information I/F controller 3120 
has a structure shown in (e) of FIG. 22. 
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The encrypted information is decrypted 
(deciphered) every encryption unit, and encryption 
units of decrypted, plane information are re-arranged 
to an original data sequence. 
5 Digital information (plane digital information 

after decryption) transferred from output data/control 
information transfer destination switching unit 
(data/command bus line) 3220 is processed as follows: 

(31) the digital information is decoded by audio 
10 decoder 3220 to obtain a linear PCM signal, which is 

temporarily saved in audio buffer 3410, when it is 
audio information; 

(32) the digital information undergoes "code -» 
character conversion" by character generator 3340, and 

15 is then temporarily saved in text line buffer 3420 as 

image information when it is text information; 

(33) the digital information is converted into 
bitmap information in image decoder 3330, and is 
temporarily saved in page buffer 3430 when it is still 

20 image information compressed by JPEG or MPEG 

(I-picture); and 

(34) video processor 3370 composites the still 
image information in the bitmap format, temporarily 
saved in page buffer 3430 and the text information 

25 image temporarily saved in line buffer 3420 to generate 

a single composite image, as needed. 

The composite image obtained in this way is 
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displayed on image display 3710 such as a color liquid 
crystal display panel or the like. 

On the other hand, the audio information 
temporarily saved in audio buffer 3410 is transferred 
5 to D/A converter (DAC) 3360 in units of frames, and is 

converted into an analog signal, which is output to 
external output terminal 3720 connected to a 
loudspeaker or the like. 

Note that the display timing of text or still 
10 image information on image display 3710 upon playing 

back audio information is controlled in synchronism 
with the audio frame number to be played back. 

System controller 3020 shown in FIG. 23 sets a 
value obtained by dividing the "total number of frames" 
15 of music #(i shown in, e.g., (b) of FIG. 8 by the 

"number of still images to be displayed during 
playback" of music #P as the "number of audio frames to 
be played back per still image" . 

System controller 3020 always monitors the audio 
2 0 frame numbers in playback (the accumulated number of 

audio frames), and switches still image information in 
page buffer 3430, which is to be sent to image display 
(color liquid crystal display) 3710, when the played- 
back audio frame number has reached a predetermined 
25 value. 

Note that system controller 3020 in FIG. 23 mainly 
executes both the "music number combining (tune 
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combining)" and "music number dividing (tune dividing)" 
processes described earlier with reference to FIG. 2, 
and sends changed management information (CI# or AOBI#) 
to information recorder/player 3000 via output 
5 data/control information transfer destination switching 

unit (data/command bus line) 3220. 

As a result, information in management information 
recording region 130 in (d) of FIG. 5 is rewritten. In 
the "music number dividing (tune dividing)" process, 

10 information (audio data corresponding to AOBI#3, 

AOBI#5, and AOBI#6 in the example shown in (c) and (d) 
of FIG. 2) in audio object recording region 131 is also 
changed (the process for dividing audio information 
file A0BI#3 into A0BI#5 and AOBI#6). 

15 FIG. 25 is a flow chart for explaining the method 

of making only an image pointer (IPI) of the first AOBI 
(TKI) in a music number /tune (track) valid as a pointer 
of a still image to be displayed when the music 
number /tune (track) is made up of a plurality of pieces 

20 of AOBI (TKI) . 

The number of pieces of AOBI (TKI in FIG. 21) 
(three pieces of AOBI in music #0 in FIG. 8; three 
pieces of TKI in music B in FIG. 21) is detected from 
PGCSI/AOBSI or the like shown in FIG. 5 or FIG. 8 

25 (step ST1000). 

If the detected number of pieces of AOBI (TKI) is 
1 (YES in step ST1002), image pointer information IPI 
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(TKI_IOB_SRP) of one AOBI (AKI) which forms that music 
number/tune (track) is used (step ST1004). 

On the other hand, if a plurality of pieces of 
AOBI (AKI) are detected (NO in step ST1002), only image 
5 pointer information IPI (TKI_IOB_SRP) of the first AOBI 

(TKI) in the music number/tune (track) of two or more 
pieces of AOBI (TKI) which form that music number /tune 
(track) is used (step ST1006). 

Then, the recorded/unrecorded flag (2 bits) in (e) 
10 of FIG. 16 or (d) of FIG. 19 is read (step ST1008). 

For example, if this 2-bit flag is 00b, it 
indicates the absence of corresponding still image data 
(IMGxx.IOB) (i.e., no still image data is recorded). 
If this 2-bit flag is 01b, it indicates the presence of 
15 corresponding still image data (IMG_xx.IOB) (i.e., 

still image data is already recorded) . 

If this 2-bit flag is 10b, it indicates the 
presence (recorded) of, e.g., still image data with 
text; if this 2-bit flag is lib, it indicates, for 
20 example, the presence (recorded) of data (text data 

alone, motion JPEG file, etc.) other than a still 
image . 

Such recorded /unrecorded flag is managed together 
in independent directory 24 00 on the file system shown 
25 in FIG. 7. 

If the recorded /unrecorded flag indicates the 
presence of corresponding still image data (IMG_xx.IOB) 
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(YES in step ST1010), the recorded, corresponding still 
image data (IMG_01.IOB designated by IPI#1 in, e.g., 
music #a in FIG. 8) is accessed using image pointer 
information IPI (TKI_IOB_SRP) of the AOBI (TKI), use of 
5 which is determined in step ST1004 or ST1006 upon 

playing back the music number /tune (track) of interest 
(step ST1012) . 

If the recorded/unrecorded flag indicates the 
presence of corresponding text data (TXT_xx.TOB) (YES 

10 in step ST1014), the recorded, corresponding text data 

(TXT_02.TOB and TXT_03.TOB designated by TPI#2 in, 
e.g., music #P in FIG. 13) is accessed using text 
pointer information TPI (see FIGS. 13 and 14) of the 
AOBI ( TKI ) , use of which is determined in step ST1004 

15 or ST1006 upon playing back the music number/tune 

(track) of interest (step ST1012). 

The accessed still image data and/or text data 
are/is played back upon playback of the music 
number/tune of interest, and are/is displayed on, e.g., 

20 image display 3710 in FIG. 23 (step ST1018). 

FIG. 26 is a flow chart for explaining the method 
of matching the display order mode/ still image display 
timing mode of divided music numbers (divided tunes) 
with those before the dividing process, matching text 

2 5 information associated with the divided music numbers 

(divided tunes) with that before the dividing process, 
and copying all kinds of still image information and 
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text information in newly created AOBI (TKI) from the 
same kinds of information of AOBI (TKI) older than the 
new AOBI (TKI) . 

Music/tune (track) #cc having AOBI (TKI) #1 in FIG. 
5 4 is divided to generate new music number /new tune 

(track) #a having AOBI (TKI) #1, and new music 
number /new tune (track) having AOBI (TKI) #8 (step 
ST2000) . 

It is then checked if image pointer information 

10 IPI#1 included in music #a before the dividing process 

includes a description of display mode information (51, 
52) shown in FIGS. 10, 20, etc. (step ST2002). 

If image pointer information IPI#1 includes the 
description of display mode information (51, 52) (YES 

15 in step ST2002), the display mode information (51, 52) 

of image pointer information IPI#1 included in music #a 
before the dividing process is transplanted (copied) to 
new music #a and new music #C generated by the dividing 
process (step ST2004). 

20 The display mode information (51, 52) transplanted 

(copied) to new music #ot and new music #C is stored in 
the internal RAM of system controller 3020 in FIG. 23, 
and/or is recorded in RAM 104 in (a) of FIG. 5 (or data 
region 1820 in (b) of FIG. 6). 

25 It is checked if music #a before the dividing 

process includes a description of text pointer 
information TPI (step ST2006). 
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If music #a includes the description of text 
pointer information TPI (YES in step ST2006), the 
contents of text pointer information TPI#1 included in 
music #a before the dividing process are transplanted 
5 (copied) to new music #a and music #C generated by the 

dividing process (step ST2008). 

The text pointer information transplanted (copied) 
to new music #a and new music #C is stored in the 
internal RAM of system controller 3020 in FIG. 23, 
10 and/or is recorded in RAM 104 in (a) of FIG. 5 (or data 

region 1820 in (b) of FIG. 6). 

The transplanted (copied) display mode information 
(51 r 52) and/or text pointer information are/is set in 
each AOBI (TKI) of new music #a and new music #C (step 
15 ST2010). 

In this case, the transplanted (copied) display 
mode information (51, 52) and/or text pointer 
information may be set not only in AOBI having valid 
image pointer information IPI but also in each AOBI 
20 having invalid IPI. 

Still images and/or text (that can include jacket 
images, word cards, and the like) are played back and 
displayed while being switched as needed on the basis 
of all pieces of transplanted (copied) information 
25 (including display mode information and/or text 

information) ( step ST2012 ) . 

FIG. 27 is a flow chart for explaining the method 
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of matching the display order mode/still image display 
timing mode of the combined music number (combined 
tune) with those to be played back first by merging 
still image information in a succeeding music number 
(succeeding tune) with that in a preceding music number 
(preceding tune) when two music numbers/two tunes 
(tracks) are combined to generate a new music 
number/new tune (track). 

Music/tune (track) #ct having AOBI (TKI) #1 and 
music /tune (track) #P having AOBI (TKI) #2 are combined 
to generate music #y (step ST3000). 

In this case, in the example shown in FIG. 1, 
pieces of still image information IMG_03.IOB and 
IMG_04.IOB of music #p are merged with pieces of still 
image information IMG_01.IOB and IMG_02.IOB of 
preceding music #a, so that music #y has pieces of 
image information IMG_01.IOB to IMG_04.IOB. 

Of combined music number /combined tune (track) #y, 
display mode information (51, 52 in FIG. 20) in image 
pointer information IPI of AOBI#l of music #a to be 
played back first is used as that of combined music #y 
(step ST3002) . 

If the display mode information used includes a 
description of display order setting mode information 
(51 in FIG. 20) (YES in step ST3004), the display 
method of still images (IMG_xx.IOB) of music #y is 
determined in accordance with the contents of the 
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display order setting mode information (step ST3006). 

Examples of the display method determined in this 
step include sequential display, random display, 
sequential display after shuffling, display while 
5 browsing images, and the like. 

If the display mode information used includes a 
description of display timing setting mode information 
(52 in FIG. 20) (YES in step ST3008), the display 
timings of still images (IMG_xx.IOB) of music #y are 
10 determined in accordance with the contents of the 

display timing setting mode information (step ST3010). 

Examples of the display timing determined in this 
step include the still image display switching timings 
synchronized with divisions of audio frames (see (c) of 
15 FIG. 22 of music #y to be played back, the still image 

display switching timings set at given time intervals 
using a timer, and the like. 

Upon playback of music #y, still images (that can 
include text information such as words and the like as 
2 0 needed) are played back and displayed while being 

switched based on the determined display method 
(display order) and/or at the determined display 
timings (step ST3012). 

FIG. 28 is a flow chart for explaining the method 
25 of displaying jacket images using still image 

information of a music number /tune (track) included in 
a selected play list or a selected music 
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number/selected tune (track) when a play list or music 
number /tune (track) is selected. 

It is checked if a play list (default play list or 
user-defined play list) is selected (step ST4000). 

This checking is done by system controller 3020 in 
FIG. 23 in response to depression of a play list select 
button on a remote controller (not shown) by the user. 

If the play list is selected (YES in step ST4000), 
the first music number/first tune (music #a in the 
default play list or music #P in the user-defined play 
list in FIG. 10) is specified (step ST4002). 

On the other hand, if the play list is not 
selected (NO in step ST4000) but if a specific music 
number/specific tune (track) is directly selected (YES 
in step ST4004), the selected music number/ selected 
tune (the music number/tune of user's choice), e.g., 
music #P in FIG. 10, is specified (step ST4006). 

Such direct selection of a music number/tune 
(direct music number designation or direct tune 
designation) is done by system controller 3020 in 
FIG. 23 in response to depression of a music 
number/tune (track) select button on the remote 
controller (not shown) by the user. 

Some or all pieces of image information 
(IMG_02.IOB to IMG_04.IOB for music #(3 in the example 
shown in FIG. 10) designated by image pointer 
information IPI of the specified music number/ specif ied 
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tune are allowed to be used in display of jacket images 
and/or word cards (text images based on text pointer 
information TPI) on the basis of the contents of 
recorded/unrecorded flags (see FIG. 16, FIG. 17, or 
FIG. 19) and the contents of designation 
presence/absence flags (see FIG. 18) of jacket images 
and the like (step ST4008). 

Some or all pieces of image information 
(IMG_02.IOB to IMG_04.IOB for music #|3 in the example 
shown in FIG. 10) which are allowed to be used are 
displayed in accordance with the display method (e.g., 
sequential) designated by display order setting mode 
information 51 included in display mode information 
(see FIG. 10 or FIG. 20) and the display timings (e.g., 
in units of a predetermined number of audio frames) 
designated by display timing setting mode information 
52 included in the display mode information, upon 
playback of the selected music number/selected tune 
(music #(3 in the example in FIG. 10) (step ST4 010). 

The advantages or effects obtained according to 
the embodiment of the present invention described above 
may be summarized as follows. 

1. According to the embodiment of the present 
invention, audio information with still images (audio 
information that can simultaneously play back still 
images) can easily undergo an edit process such as a 
music number combining process (tune combining 
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process), dividing process, or the like within a short 
period of time without largely changing management 
information. 

2. In the edit process such as a music number 
combining process (tune combining process), music 
number dividing process (tune dividing process), or the 
like, still images to be displayed upon playback of 
audio information can be easily set in units of music 
numbers ( in units of tunes ) . 

3. Even after music numbers (tunes) are combined, 
the playback range of a music number (tune) before the 
combining process is left or remained as a "management 
unit (cell/AOB/track) " indicating the playback range in 
audio information (AOB), and management information 
(CI/AOBI/TKI) that pertains to the management unit is 
recorded on the information storage medium as 
management information. Hence, the contents of 
management information need only be changed slightly 
before and after the music number combining process 
(tune combining process), and control upon editing can 
be facilitated. 

4. When one music number (tune) is made up of a 
plurality of "management units (cells/AOBs/tracks ) " (as 
a result of, e.g., the music number combining 
process/tune combining process), since designation 
information that pertains to still image information 
described within management information (Cl/AOBl/TKI ) 
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which pertains to the management unit to be played back 
first in that music number (tune) indicates still image 
information to be displayed upon playing back the music 
number (tune) of interest, the memory size of the 
5 playback apparatus can be reduced. 

In this case, when management information that 
pertains to a management unit to be played back in the 
latter half of the music number (tune) records 
designation information of still image information to 

10 be played back in units of music numbers (in units of 

tunes ) , the management information that pertains to all 
management units which form the music number (tune) of 
interest need only be temporarily saved in the memory 
of the playback apparatus before playback of the music 

15 number. 

5. Since information which designates still image 
information (IOB) rejected from the display target 
range after the music number combining process (tune 
combining process) is recorded in management 

20 information which pertains to management units 

( cells /AOBs /tracks) to be played back as the second and 
subsequent units in that music number (tune), the user 
can re-select still image information (IOB) to be 
displayed in units of music numbers (in units of 

25 tunes), using an apparatus with advanced function, for 

example . 

6 . Since designation information to still image 
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information (IOB) before the dividing process is 
directly copied and saved after the music number 
dividing process (tune dividing process), the user can 
be given a sense of security that "still image 
5 information to be displayed is saved even after the 

dividing process". 

7. Still images (that can include jacket images 
and word card images) to be played back in a given 
music number (given tune) can be displayed while being 
10 switched along with the progress of the music number 

(tune) in a predetermined order and/or at predetermined 
timings in accordance with display mode information 
included in IPI in the first AOBI/TKI of that music 
number ( tune ) . 

15 As described above, the information storage medium 

(audio card or the like) according to the present 
invention can have information (attribute information 
such as display order mode/display timing mode, and the 
like, flags indicating the presence/absence of still 

20 image information, and the like) that pertains to 

handling of various kinds of information (still image 
information such as jacket images and the like, and 
text information such as words and the like) associated 
with audio information (music number or tune). 

25 According to the information playback method of 

the present invention, corresponding jacket images, 
word text, and the like can be displayed while being 



automatically switched upon playback of a music number 
(tune), using the information (attribute information 
such as display order mode/display timing mode, and the 
like, flags indicating the presence/absence of still 
image information, and the like) that pertains to 
handling, which information is recorded on the 
information storage medium (audio card or the like). 

Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore, 
the invention in its broader aspects is not limited to 
the specific details and representative embodiments 
shown and described herein. Accordingly, various 
modifications may be made without departing from the 
spirit or scope of the general inventive concept as 
defined by the appended claims and their equivalents. 
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WHAT IS CLAIMED IS: 

1. An information storage medium having a 
recording region of audio information and image 
information, wherein 

said information storage medium adopts a first 
playback unit for playing back the audio information 
and a second playback unit, 

the first playback unit is formed of one or more 
second playback units, 

one or more pieces of management information each 
pertaining to the second playback unit are recorded, 
and 

display mode information indicating a display 
method of the image information is described in the 
management information recorded at a head position in 
the first playback unit. 

2. An information storage medium having a 
recording region of audio information and image 
information, wherein 

said information storage medium adopts a first 
playback unit for playing back the audio information 
and a second playback unit having a fineness being 
equal to or more fine than a fineness of the first 
playback unit, 

the first playback unit is formed of one or more 
second playback units, 

one or more pieces of management information each 
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pertaining to the second playback unit are recorded in 
a line, and 

display mode information indicating a display 
method of the image information is described in each 
5 management information which belongs to each of one or 

more first playback units. 

3 . An information storage medium having a 
recording region of audio information and image 
information, wherein 
10 said information storage medium adopts a first 

playback unit for playing back the audio information 
and a second playback unit having a fineness being 
equal to or more fine than a fineness of the first 
playback unit, 

15 the first playback unit is formed of one or more 

second playback units, 

one or more pieces of management information each 
pertaining to the second playback unit are recorded in 
a line, and 

20 display mode information indicating a display 

method of the image information is described in a 
default play list that defines, in advance, a playback 
order or playback sequence of one or more first 
playback units, as attribute information of each first 

25 playback unit. 

4. An information storage medium having a 
recording region of audio information and image 
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information, wherein 

said information storage medium adopts a first 
playback unit for playing back the audio information 
and a second playback unit having a fineness being 
5 equal to or more fine than a fineness of the first 

playback unit, 

the first playback unit is formed of one or more 
second playback units, 

one or more pieces of management information each 
10 pertaining to the second playback unit are recorded in 

a line, and 

display mode information indicating a display 
method of the image information is described in a play 
list in which a playback order or playback sequence of 
15 one or more first playback units is arbitrarily 

defined, as attribute information of each first 
playback unit. 

5 . An information storage medium having a 
recording region of audio information and image 
20 information, wherein 

said information storage medium adopts a first 
playback unit for playing back the audio information 
and a second playback unit having a fineness being 
equal to or more fine than a fineness of the first 
25 playback unit, 

the first playback unit is formed of one or more 
second playback units, and 



Ill - 



display mode information indicating a display- 
method of the image information is described as 
attribute information in a portion of information that 
pertains to the second playback unit. 
5 6 . A method of playing back, information from a 

medium that records audio information and image 
information in a first playback unit for playing back 
the audio information and a second playback unit having 
a fineness being equal to or more fine than a fineness 

10 of the first playback unit, wherein 

when one or more pieces of management information 
each pertaining to the second playback unit are 
recorded in a line in the medium in which the first 
playback unit is formed of one or more second playback 

15 units, 

only contents of the management information 
recorded at a head position in the first playback unit 
are used as valid information, and the image 
information is played back by accessing the image 

20 information based on the contents of the valid 

management information. 

7 . A method of playing back information from a 
medium, that records audio information and image 
information in a first playback unit for playing back 

25 the audio information and a second playback unit having 

a fineness being equal to or more fine than a fineness 
of the first playback unit, using management 
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information for managing the second playback unit, 
wherein 

a first music number indicated by the first 
playback unit is divided to generate second and third 
music numbers, 

when the management information of the first music 
number before divided has a pointer including display 
mode information indicating a display method of the 
image information, the display mode information 
included in the pointer is transplanted to management 
information of the divided second music number and 
management information of the divided third music 
number , and 

the image information is played back based on 
management information having the transplanted 
management information. 

8. A method of playing back information from a 
medium, that records audio information and text 
information in a first playback unit for playing back 
the audio information and a second playback unit having 
a fineness being equal to or more fine than a fineness 
of the first playback unit, using management 
information for managing the second playback unit, 
wherein 

a first music number indicated by the first 
playback unit is divided to generate second and third 
music numbers, 
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when the management information of the first music 
number before divided has a pointer including the text 
information, contents of the pointer are transplanted 
to management information of the divided second music 
number and management information of the divided third 
music number, and 

the text information is played back based on the 
transplanted pointer. 

9 . A method of playing back information from a 
medium, that records preceding object information 
including audio information and text information in a 
first playback unit for playing back the audio 
information and a second playback unit having a 
fineness being equal to or more fine than a fineness of 
the first playback unit, using management information 
for managing the second playback unit, wherein 

new object information including the audio 
information and the text information is generated, 

all kinds of information that pertain to the audio 
information and the text information in the preceding 
object information are transplanted to the new object 
information , and 

at least one of the audio information and the text 
information is played back based on the transplanted 
information. 

10. A method of playing back information from a 
medium, that records audio information and image 
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information in a first playback unit for playing back 
the audio information and a second playback unit having 
a fineness being equal to or more fine than a fineness 
of the first playback unit, using management 
5 information for managing the second playback unit, 

wherein 

a first music number indicated by the first 
playback unit and a second music number indicated by 
the first playback unit are combined to generate a 
10 third music number indicated by the first playback 

unit, 

when management information of the first music 
number before combined with the second music number has 
a pointer including display mode information indicating 

15 a display method of the image information, the same 

pointer as the management information of the first 
music number is provided to management information of 
the combined third music number, and 

the image information of the combined third music 

20 number is played back based on the management 

information having the same pointer. 

11. A method of playing back information from a 
medium, that records audio information and image 
information in a first playback unit for playing back 

25 the audio information and a second playback unit having 

a fineness being equal to or more fine than a fineness 
of the first playback unit, using management 



information for managing the second playback unit, 
wherein 

a preceding first music number indicated by the 
first playback unit and a succeeding second music 
number indicated by the first playback unit are 
combined to generate a third music number indicated by 
the first playback unit, 

upon generating the combined third music number, 
image information of the succeeding second music number 
is merged with image information of the preceding first 
music number, and 

the merged image information is played back upon 
playing back the combined third music number. 

12 . A method of playing back information from a 
medium, that records audio information and image 
information in a first playback unit for playing back 
the audio information and a second playback unit having 
a fineness being equal to or more fine than a fineness 
of the first playback unit, or in a unit of a play list 
that defines a sequence of one or more first playback 
units, using management information for managing the 
second playback unit, wherein 

when the play list is selected or a predetermined 
first playback unit is selected, the first playback 
unit to be played back is specified, 

specific image information is allowed to be used 
as a jacket image based on the management information 
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of the specified first playback unit, and 

the specific image information which is allowed to 
be used is played back as the jacket image upon playing 
back the specified first playback unit. 
5 13. A data structure for recording information on 

an information storage medium having a recording region 
of audio information and image information, wherein 

said data structure adopts a first playback unit 
for playing back the audio information and a second 
10 playback unit, 

the first playback unit is formed of one or more 
second playback units, 

one or more pieces of management information each 
pertaining to the second playback unit are recorded, 
15 and 

display mode information indicating a display 
method of the image information is described in the 
management information recorded at a head position in 
the first playback unit. 
20 14. A data structure for recording information on 

an information storage medium having a recording region 
of audio information and image information, wherein 

said data structure adopts a first playback unit 
for playing back the audio information and a second 
25 playback unit having a fineness being equal to or more 

fine than a fineness of the first playback unit, 

the first playback unit is formed of one or more 



second playback units, 

one or more pieces of management information each 
pertaining to the second playback unit are recorded in 
a line, and 

display mode information indicating a display 
method of the image information is described in each 
management information which belongs to each of one or 
more first playback units. 

15. A data structure for recording information on 
an information storage medium having a recording region 
of audio information and image information, wherein 

said data structure adopts a first playback unit 
for playing back the audio information and a second 
playback unit having a fineness being equal to or more 
fine than a fineness of the first playback unit, 

the first playback unit is formed of one or more 
second playback units, 

one or more pieces of management information each 
pertaining to the second playback unit are recorded in 
a line, and 

display mode information indicating a display 
method of the image information is described in a 
default play list that defines, in advance, a playback 
order or playback sequence of one or more first 
playback units, as attribute information of each first 
playback unit. 

16. A data structure for recording information on 
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an information storage medium having a recording region 
of audio information and image information, wherein 

said data structure adopts a first playback unit 
for playing back the audio information and a second 
playback unit having a fineness being equal to or more 
fine than a fineness of the first playback unit, 

the first playback unit is formed of one or more 
second playback units, 

one or more pieces of management information each 
pertaining to the second playback unit are recorded in 
a line, and 

display mode information indicating a display 
method of the image information is described in a play 
list in which a playback order or playback sequence of 
one or more first playback units is arbitrarily 
defined, as attribute information of each first 
playback unit. 

17. A data structure for recording information on 
an information storage medium having a recording region 
of audio information and image information, wherein 

said data structure adopts a first playback unit 
for playing back the audio information and a second 
playback unit having a fineness being equal to or more 
fine than a fineness of the first playback unit, 

the first playback unit is formed of one or more 
second playback units, and 

display mode information indicating a display 
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method of the image information is described as 
attribute information in a portion of information that 
pertains to the second playback unit. 
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ABSTRACT OF THE DISCLOSURE 
An information storage medium has a first playback 
unit (music number or tune) for playing back the audio 
information and a second playback unit (AOB) being more 
5 fine than the first playback unit (music number) , and 

one or more pieces of management information (AOBI) 
each pertaining to the second playback unit (AOB) are 
recorded in a line (arrangement sequence of AOBI# in 
music #). Display mode information indicating the 
10 display method (display order /display sequence, display 

timing) of image information (IMG_xx.IOB) is described 
in management information (AOBI# in music #) recorded 
at the head position in the first playback unit (music 
number) of this management information (AOBI). 
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CELL 

INFORMATION 
Cl#1 161 


Cl#2 162 


Cl#3 163 


Cl#4 164 


Cl#5 
165 



MUSIC 
#y' 313 


MUSIC 

#/?' 312 


Cl#11 

167 


Cl#12 
168 


Cl#13 
169 




: IG.13 



i 




>' 


>' 










ATS 




ATS 




ATS 




ATS 




ATS 




TXT 




TXT 




TXT 


01. 




02. 




03. 




04. 




05. 




01. 




02. 




03. 


AOB 




AOB 




AOB 




AOB 




AOB 




TOB 




TOB 




TOB 


221 




222 




223 




224 




225 




231T 




232T 




233T 



PGC SET INFORMATION (PGCSI) RECORDING REGION 140 



ORG_PGC RECORDING REGION 150 



UD_PGC#A RECORDING 
REGION 151 



MUSIC 
#a 301 


MUSIC 
#/? 302 


Cl#1 161 


Cl#2 162 


Cl#3 163 


TPI#1 
196T 


TPI#2 
197T 


TPI#3 
198 









MUSIC 

#/r 312 



Cl#13 169 



TPI#13 
199 



MUSIC 
#<*' 313 



Cl#14 170 



TPI#14 
200T 



AOBSI RECORDING REGION 141 



AOBI#1 
171 



o 

Q_ I- 



AOBI#2 
172 



AOBI#3 
173 



.TOBSl RECORDING REGION 143 



=>\-c=> 

CO <C CM 

0 ^ _ 

1 i i O 



o o i— 

CO <C CM 

i_ £ * 

LLI ^ O 



(d) 

( 



ATS 




ATS 




ATS 


01. 




02. 




03. 


AOB 




AOB 




AOB 


221 




222 




223 





PGC SET INFORMATION (PGCSI) RECORDING REGION 140 



(b) 



ORG_PGC RECORDING REGION 150 



UD_PGC#A RECORDING 
REGION 151 



MUSIC 
#<x 301 


MUSIC 
#/5 302 


MUSIC 
#y 303 


CELL 

INFORMATION 
Cl#1 161 


CM 
CO 

CM 

=8= 

o 


CO 
CO 

O 


co 
O 


Cl#5 
165 



MUSIC 
#y* 313 


MUSIC 
#/?' 312 


Cl#11 
167 


Cl#12 
168 


Cl#13 
169 




i 


/ 


/ 


>'' 










ATS 




ATS 




ATS 




ATS 




ATS 




TXT 




TXT 




TXT 


01. 




02. 




03. 




04. 




05. 




01. 




02. 




03. 


AOB 




AOB 




AOB 




AOB 




AOB 




TOB 




TOB 




TOB 


221 




222 




223 




224 




225 




231 T 




232T 




233T 
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IOBSI. IFO FILE 2130 

(IMAGE OBJECT SET INFORMATION RECODING REGION 142) 


DATA DATA DATA 
SIZE WITH SIZE WITH SIZE WITH 
FIXED LENGTHlFIXED LENGTHlFIXED LENGTH 




DATA : 
SIZE WITH i 
FIXED LENGTH 








IOBSI 

MANAGEMENT 
INFO. 10 


MANAGEMENT 
INFO. 1 
CONCERNING 
IMG 01. IOB 


MANAGEMENT 
INFO. 2 
CONCERNING 
IMG 02. IOB 




MANAGEMENT 
INFO. 9 
CONCERNING 
IMG 999. IOB 





IMAGE OBJECT SET 
GENERAL INFO. 
IOBS_GI • 11 



IMAGE OBJECT SET 
BIT MAP INFO. 12* 



NUMBER OF 


FINAL NUMBER 
INFO. ON 
RECORDED 
STILL IMAGE 
(IOB) FILE 22 


MANAGEMENT 


BIT MAP INFO. 
ON STILL IMAGE 


RECORDED 


INFO. ON STILL 


(IOB) FILE 


STILL IMAGE 


IMAGE ID INFO. 


SPECIFIED FOR 


(IOB) FILES 21 


26* 


REPRESENTATIVE 
IMAGE 27 



CD 



i * 



Q CO 
fZ LU CQ ^ 

<Q<m 

=g o o — 
^ o ^ - 

CC LU LU ~pZ 
O CC CO I 

_§ £ - 

S uj <c u_ 

£ggo 



F= LU <c __ 
<C O Q LL. 

|8oo 

DC LU 

o en cq 

O =3 — <C 
°t LU 0,Q 



^ O LU 
_3 LU Ll_ DC 
U_ DC O Q- 



I — LU <C _J 
<QQLL 
ioDCLU 

|ooo 

DC LU — fri 

occm^ 

Q ^ <C 

!< O LU 
_jLULL.CC 
LL. DC O D_ 



LU -5f 

lu <c __3 

<QQLL 
DC LU ^ 

n- Q lD 
2gcD'g 

_5 LU U_ DC 

-gQQ- 



^^CD 

P= LU ^ _J 

<C Q Q U_ 

o cc co 

WZO_ 
n-QloiTi 

^-GCCDg 

_LULL_ 
U-CCQ Q_ 
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FLAGS INDICATING PRESENCE/ABSENCE OF STILL IMAGE DATA 
(TOTALLY MANAGED BY FILE OF SUBDIRECTORY 2400) 



(a) 



"NUMBER OF 
RECORDED 
STILL IMAGE 
(lOB) FILES" 21 


"FINAL NUMBER 
INFO. ON 
RECORDED 
STILL IMAGE 
(lOB) FILE" 22 


MANAGEMENT 
INFO. ON STILL 
IMAGE ID INFO. 
26* 


"BIT MAP INFO. 
ON STILL IMAGE 
(lOB) FILE 
SPECIFIED FOR 
REPRESENTATIVE 
IMAGE" 27 



(b) 



(e) 



O CD 

o • 

LU 5 
CD DC I 



QC ^ LU u_ 
OO 
LJ- — rr 
DC ?=i LU 

Ll Q DC CO 



Q CO 



pSIoo 

U- — CC 

u-Qcrco 



Q CQ 



LL- — OC 
LL. Q CC CO 



Q CO 

g£ 
as 

cd cc i 
zzo 
f= ^ 51 

21g° 

CC LU 
Ll_ Q QC CO 



Q OQ 

g^ 

as 

CD DC I 



9ioo 

U- _ rr 
CC o LU 

^coLui^ 

LU Q DC CO 



LU CD 

O - 

CD DC 
^ ^ CD 

Plgo 

rr Sin 
CDogfe= 
LL. Q DC CO 



01 



00 



00 



01 



00 




DATA PRESENCE/ABSENCE FLAGS (2 BITS) 
1 MANAGED TOGETHER IN SINGLE FILE 



PRESENCE 
OF IMG_01 
JOB 



PRESENCE 
OF IMG_03 
lOB 



NO STILL 

IMAGE 

DATA 



PRESENCE 
OF IMG_05 
JOB 



'1ST ONE OF JACKET IMAGE, ETC 



NO STILL 




PRESENCE 


IMAGE 




OF IMG 07 


DATA 




JOB 










PRESENCE 




PRESENCE 


OF IMG 51 




OF IMG 52 


JOB 




■lOB " v 



PRESENCE 
OF IMG_08 
lOB 



NO STILL 

IMAGE 

DATA 




* WHERE CONTENTS OF FINAL NUMBER 
INFORMATION 22 OF RECORDED 
STILL IMAGE (lOB) FILE IS "52" 



^52ND ONE OF JACKET IMAGE, ETC. 



FIG. 17 



IOBSI. IFO FILE 2130 

(IMAGE OBJECT SET INFORMATION RECODING REGION 142) 



■DATA DATA DATA 

SSIZE WITH SIZE WITH .SIZE WITH , 

IFIXED LENGTH! FIXED LENGTH IFIXED LENGTH! 



DATA 

SIZE WITH 
FIXED LENGTH 



IOBSI 

MANAGEMENT 
INFO. 10 


MANAGEMENT 
INFO. 1 
CONCERNING 
IMG 01. IOB 


MANAGEMENT 
INFO. 2 
CONCERNING 
IMG 02. IOB 




MANAGEMENT 
INFO. 9 
CONCERNING 
IMG 999. IOB 





IMAGE OBJECT SET 
GENERAL INFO. 
IOBS_GI • 11 



IMAGE OBJECT SET 
BIT MAP INFO. 12 



(c) 



(d) 



NUMBER OF 
RECORDED 
STILL IMAGE 
(IOB) FILES 21 



FINAL NUMBER 
INFO. ON 
RECORDED 
STILL IMAGE 
(IOB) FILE 22 



BIT MAP INFO. 
ON UNRECORDED 
STILL IMAGE 
(IOB) FILE 26 



BIT MAP INFO. 
ON STILL IMAGE 
(IOB) FILE 
SPECIFIED FOR 
REPRESENTATIVE 
IMAGE 27 



CD 

ZL 

Zj UJ 

93 LU — 
<C ^ _J 

CO ^ 

Q <C -j- 

Olucc 
— co o 
cd£° 

^luCD 

^1 

^ U_ CD 

LUOh-O 

s z ^ ■ 
2go5, 
,_ Ec cd 

5^jg 



CD 



5a lu^ 
<c _i 

CO ^ 

L -> <c m 
ccz»- 
Oluoc 
" — to o 
CD£ 0 

^ u_ — CO 
U-iOj—O 
cc zz. - 



10 



CD 

in uj 

O LU cil 

— co o 
cd£° 

ziL-m 

LLI O I— O 

oc^ - 

co§^CD 



10 



O uj cc 
— o 
2£ , 



^ U_ — CQ 
LU O 1— O 

oooS 

^t-<C-3CD 



U_ Q _ U_ 



00 



CD 

_. LU 

<C ~£ _J 
CO =2 

O LU DC 
— CO o 
CD£° 
^ £ LU 

uj CD 
3 = 3 

U_ — CQ 
UJ O | — O 

cc ^ ^ . 

eggs, 

CD LU — 



00 



CD 

Zj lu 
m uj ^ 

<C tr _J 
CO ^ 

rS 1X1 

O LU DC 
— CO O 
CD^ 0 
^51 LU 
ZZiujCD 
co ^ ^ 

ZL U_ — o 
LU O 1 — 
PC 7 y O) 

o,§-^CD 

11 



FIG. 18 



r 

(a) 



IOBSI. IFO FILE 2130 

(IMAGE OBJECT SET INFORMATION RECODING REGION 142) 



DATA 

SIZE WITH 
FIXED LENGTH 


DATA DATA 
SIZE WITH SIZE WITH 
FIXED LENGTH iFIXED LENGTH 




DATA 

SIZE WITH 
FIXED LENGTH 










IOBSI 

MANAGEMENT 
INFO. 10 


MANAGEMENT 
INFO. 1 
CONCERNING 
IMG 01. IOB 
/COUNT INFOA 
OF IOB j 


MANAGEMENT 
INFO. 2 
CONCERNING 
IMG 02. IOB 
/COUNT INFOA 
iOF IOB J 




MANAGEMENT 
INFO. 9 
CONCERNING 
IMG 999. IOB 
/COUNT INFOA 
OF IOB j 



(d) 



ATTRIBUTE INFO. 431 
ON STILL IMAGE (IOB) 


REPRESENTATIVE IMAGE 
(OR JACKET IMAGE, ETC.) 
DESIGNATION STATE INFO. 432 




*N DENOTES A POSITIVE FIXED NUMBER 


STILL IMAGE COMPRESSION 
METHOD AND COMPRESSION 
VERSION INFO. 441 


STILL IMAGE RESOLUTION INFO. 442 


FLAG FOR DISCRIMINATING 

RECORDED/UNRECORDED 

STATE OF IMG 01. IOB 

(OR DATA PRESENCE/ABSENCE FLAG) 41 * 


INFO. ON MUSIC NUMBER 
DESIGNATED AS 

REPRESENTATIVE IMAGE, ETC. 450 


MUSIC NUMBER OR AOBI 
NUMBER/CI NUMBER/TKI NUMBER 
DESIGNATED AS FIRST 
REPRESENTATIVE IMAGE, ETC. 451 




MUSIC NUMBER OR AOBI 
NUMBER/CI NUMBER/TKI NUMBER 
DESIGNATED AS N-TH 
REPRESENTATIVE IMAGE, ETC. 452 





-< INFO. SIMILAR TO THOSE IS STORED IN MANAGEMENT 

V_ INFO. 1 TO 9 OF IMG_xx.lOB (xx=01 TO 999) 



FIG. 19 



IMAGE POINTER INFO. (IP!) 40 IN AOBI (TKI) AT HEAD OF MUSIC NUMBER 



DISPLAY MODE INFO. 43 DISPLAY MODE INFO. 47 
ON STILL IMAGE IN UNITS ON STILL IMAGE IN UNITS 
OF MUSIC NUMBERS, OF MUSIC NUMBERS, 
PGCs, OR PLAY LISTS PGCs, OR PLAY LISTS 



DISPLAY MODE INFO. (51,52) 



STILL IMAGE 
DISPLAY 
SEQUENCE SET 
MODE INFO. 51 



DESIGNATION OF 
DISPLAY METHOD 
(SEQUENTIAL, 
RANDOM, 
SHUFFLE, 
BROWSE, ETC.) 



STILL IMAGE 
DISPLAY TIMING 
SET MODE INFO. 
52 



SETTING OF 
DISPLAY TIMING 
SYNCHRONIZED 
WITH BOUNDARIES 
OF AUDIO FRAMES 
OF AOB MANAGED 
BY AOBI (TKI) 









LU >- 




LU| 




si 


$ o 








— CO 




_l CO 


<2cO~ 


di 




=J ZD 
£ S 


Q DC 
LU 






u_ 


co en 




RO 


IMAGE 
C NUM 


LAYED 
ORDS 
1 




SPLAYE 
ORDS 
9 




t-l_ > CO 
CO > 








o co o 

, <UJ 




t<LU 


U-.LUCO 

oO-j 








LU — i 








NUMB 
IN UN 
OR PI 


INFO. 
(TEXT 
BE C 




INFO. 
(TEXT 
BE C 



*M DENOTES A POSITIVE FIXED NUMBER j 


FLAG 71 FOR DESIGNATING 
REPRESENTATIVE IMAGE, JACKET 
IMAGE, ETC., IN UNITS OF MUSIC 
NUMBERS, PGCs, OR PLAY LISTS 


STILL IMAGE FILE NUMBER OF M-TH 
DISPLAYED STILL IMAGE IN MUSIC 
NUMBER, IN PGC, OR IN PLAY LISTS 
72 



(d) 
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PLAY LIST MANAGER PLM 

(ORIGINAL DEFAULT PLAY LIST PPL) 



USER DEFINED 
PLAY LIST 



DEFAULT PLAY LIST GENERAL INFO. 


PLAY LIST GENERAL INFO. 


MUSIC A 


MUSIC B 




MUSIC B 


MUSIC A 


AOB 

GENERAL 
INFO. 


AOB GENERAL INFO. 
(GENERAL INFO. OF TRACK TK) 


Q 
LU 

Q 


AOB 

GENERAL 
INFO. 


AOB 

GENERAL 
INFO. 


DISPLAY 

MODE 

(51,52) 


ATTRIBUTE INFO. (DISPLAY 
MODE INFO.51,52) OF DISPLAY 
MODE (DISPLAY SEQUENCE 
SETTING MODE/DISPLAY TIMING 
SETTING MODE) 


CC 

O 
o 

LU 
CC 

ZD 


DISPLAY 

MODE 

(51,52) 


DISPLAY 

MODE 

(51,52) 


DPL TK 

_SRP#1 


DPL TK 
_SRP#2 


DPL TK 
_SRP#3 


DPL TK 
_SRP#5 


DPL TK 
_SRP#4 


DPL TK 
_SRP#2 


DPL TK 
_SRP#1 



a: 



TKIJOB 
_SRP 



TMSRT 



TKIJOB 
_SRP 



TMSRT 



TKIJOB 
_SRP 



TMSRT 



Pl5 



TRACK MANAGER TKM 



TKIJOB 
_SRP 



TMSRT 




JACKET IMAGE, 

WORD CARD IMAGE, ETC. 



AOB001. 
SA1 



AOB002. 
SA1 



AOB003. 
SA1 



AOB005. 
SA1 



DISTRIBUTION 
FILE (MUSIC B) 



FIG. 21 



! SPECIFIC ! SPECIFIC ' 
TIME TIME 
AUDIO OBJECT AOB 



1OB001. 
I0B 



<C LU 
or =! 



IOB002. 
IOB 



IMAGE OBJECT IOB 



AUDIO OBJECT (AOB) FILE 2500 
(ATS_01. AOB OR THE LIKE) 




AUDIO OBJECT 
UNIT AOBU 
2510 


AOBU 
2520 




AOBU 
2530 




AUDIO FRAME 
(AOB FRAME) 
2610 


AOB 

FRAME 

2620 




AOB 

FRAME 

2630 




ADTS HEADER 2710 


COMPRESSED (ACC) AUDIO 
INFORMATION RECORDING REGION 
2740 


FIXED HEADER 
2720 

f INCLUDING AOB \ 
SYNCHRONIZING 
I WORD I 


VARIABLE 

HEADER 

2730 





ENCRYPTING REGION 2820 






CD 


CD 


CD 


CD 


CD 


CD 


_o> 


NON-ENCRYPTING 


TIN 


z 


TIN 


TIN 


z 
\— 


TIN 


z 
o 


REGION 2810 






Ol. o 




1* 




CD 






o tz 


^* 

o tz 




si 


ot 
z z 


LU 

DC 




z Z 

LU ZD 


Z Z 
LU ZD 


z z 

LU ZD 


z z 

LU ZD 


LU ZD 


LU ZD 
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CCD 

CAMERA 3610 



TV 

TUNER 
3620 



VIDEO 
CAPTURE 
SECTION 
3510 



X 



DIGITAL 
CAMERA 
3630 



DIGITAL 
CAMERA 
l/F 

PROCESSING 

SECTION 

3520 



X 



TEXT 

INFORMATION 
INPUT 
SECTION 
/ KEYBOARD \ 
OR INPUT 
I DIAL I 
3530 



X 



DATA 
INPUT PC 
3640 



ANALOG 


VOICE 


INPUT 


INPUT 


TERMINAL 


MICROPHONE 


3570 


3650 



SWITCHING SECTION (DATA BUS LINE) 
FOR INPUT DATA TRANSFER DESTINATION 
3210 



MEMORY 

CARD 

100 



ENCRYPTION/DECRYPTION 
PROCESSING SECTION 3010 



INFORMATION 

RECORDING 

AND 

REPRODUCING 

SECTION 

3000 

T 



command; data 
line ! ^line 



INTER-PC 
DATA l/F 
PROCESSING 
SECTION 
3540 

^ AUDIO ENCODER 
(MPEG2AAC ) 
I COMPRESSION] 
3310 



ADC 
3350 



MICROPHONE 
INPUT 
TERMINAL 
3560 



DIGITAL 
J INPUT 
^TERMINAL 

3580 



ENCRYPTION PROCESSING SECTION 
3110 



x 



MATUAL 

AUTHENTICATION/ 
KEY EXCHANGE 
& ENCRYPTION 
INFORMATION l/F 
CONTROL SECTION 
3120 



X 



ENCRYPTION 
KEY 

GENERATING/ 
STORAGE 
SECTION 
3140 



DECRYPTION PROCESSING SECTION 

3130 



SYSTEM 
CONTROL 
SECTION 
fCPU/MPU; ) 
iROM; RAM J 
3020 



SWITCHING SECTION (DATA/COMMAND BUS LINE) 
FOR OUTPU DATA AND/OR CONTROL INFORMATION 
TRANSFER DESTINATION 3220 



X 



image decoder 
/decompressing 
section for 
compressed 
still image 
information; 
jpeg expansion 
Iprocessing 

3330 




AUDIO DECODER 
DECOMPRESSING 
SECTION FOR 
COMPRESSED 
AUDIO 

INFORMATION; 

AAC EXPANSION 
IPROCESSING 
3320 



X 



AUDIO BUFFER 3410 



_ uj O 
O o i= 

woo 
Qcciii 

> Q- GO 



DAC 3360 



EXTERNAL OUTPUT 
TERMINAL 3720 
[TO HEAD PHONE j 
[OR SPEAKER J 



IMAGE DISPLAY SECTION 3710 
( SUCH AS COLOR LIQUID CRYSTAL 
[DISPLAY SECTION OR THE LIKE 



F I G. 23 



( START ) 



MUTUAL AUTHENTICATION PROCESSING BETWEEN MEDIUM 
AND DEVICE (MEDIUM ID AND DEVICE ID CHECK) <ST10> 



GENERATE COMMON ENCRYPTION KEY (DECRYPTION KEY) 
BETWEEN MEDIUM AND DEVICE (BASED ON RANDOM 
NUMBER), AND STORE GENERATED KEY <ST12> 



ENCRYPTION PROCESSING FOR AUDIO (VOICE) AND/OR 
IMAGE INFORMATION BY COMMON ENCRYPTION KEY <ST14> 



DURING RECORDING > PROCESSING FOR TRANSFERRING 
ENCRYPTED AUDIO/IMAGE INFORMATION TO MEDIUM 
DURING REPRODUCING > PROCESSING FOR TRANSFERRING 
ENCRYPTED AUDIO/IMAGE INFORMATION TO DEVICE <ST16> 



DECRYPTION PROCESSING FOR AUDIO/IMAGE NFORMATION 
USING COMMON ENCRYPTION KEY INFORMATION <ST18> 



( END ) 

F I G. 24 



DETECT NUMBER 

[THREE PIECES OF AOBI IN MUSIC # (S IN FIG. 8;' 

ITHREE PIECES OF TKI IN MUSIC B IN FIG. 21 

OF PIECES OF AOBI (TK I IN FIG. 21) 

THAT FORM MUSIC NUMBER (TRACK) 

FROM PGCSI/AOBSI OR THE LIKE IN FIG.5 OR 8 



^STIOOO 



ST1 002 ~ 



DETECTED NUMBER=1 ? 



ST1004 



TYES 



USE IMAGE POINTER 
INFORMATION IPI (TK I _ I OB_SRP) 
IN AOBI (TKI) IN MUSIC NUMBER 
(TRACK) 



NO 



A PLURALITY 0F\ 
PIECES OF AOBI 
ARE DETECTED / 



USE ONLY IMAGE POINTER 
INFORMATION IPI 
(TKI_IOB_SRP) IN FIRST AOBI 
(TKI) IN MUSIC NUMBER (TRACK) 



T 



READ RECORDED/UNRECORDED FLAG IN 
FIG. 16 OR 19 



^ST1008 ST1006 



ST1010 




ACCESS STILL IMAGE DATA USING POINTER 
INFORMATION IPI (TKI_IOB_SRP) 
UPON PLAYBACK OF MUSIC NUMBER 



^ST1012 



ST1014 




ACCESS TEXT DATA USING TEXT POINTER 
INFORMATION TP I OF FIRST TOBI 
(T0BI#2 IN MUSIC #/? IN FIG. 13) THAT FORMS 
MUSIC NUMBER (TRACK) FROM PGCSI/TOBSI IN 
FIG.5 OR 13 



-ST1016 



PLAY BACK AND DISPLAY STILL IMAGE 
AND/OR TEXT 



c 



END 



3 



-ST1018 



FIG. 25 



( START ) 



GENERATE NEW MUSIC (TRACK) #a HAVING AOBI (TKI) 
#1 AND NEW MUSIC (TRACK) # £ HAVING AOBI (TKI) #8 
BY DIVIDING MUSIC $a HAVING AOBI (TKI) #1 IN FIG.4 



-ST2000 



ST2002 ^^"DOES IMAGE POINTER 

INFORMATION IPI#1 CONTAINED 
IN MUSIC # a BEFORE DIVIDE PROCESS CONTAIN 
DESCRIPTION OF DISPLAY MODE 
INFORMATION (51, 52)^ 
ST2004 " — ? 
I ^ YES 



NO 



TRANSPLANT (COPY) DISPLAY MODE INFORMATION OF IMAGE 
POINTER INFORMATION IPI#1 CONTAINED IN MUSIC %a 
BEFORE DIVIDE PROCESS TO NEW MUSIC %a AND 
MUSIC GENERATED BY DIVIDE PROCESS 



ST2006 



ST2008 

J. 



DOES MUSIC % a BEFORE 
DIVIDE PROCESS CONTAIN DESCRIPTION OF 
TEXT POINTER INFORMATI 



ION 



YES 



TRANSPLANT (COPY) TEXT POINTER INFORMATION TPI#1 
CONTAINED IN MUSIC #^ BEFORE DIVIDE PROCESS TO NEW 
MUSIC #<ar AND MUSIC GENERATED BY DIVIDE PROCESS 



ST2010 



SET TRANSPLANTED (COPIED) DISPLAY MODE INFORMATION AND/OR 
TEXT POINTER INFORMATION IN EACH AOBI (TKI) OF NEWLY 
GENERATED MUSIC # or AND MUSIC 

(SUCH INFORMATION MAY BY SET NOT ONLY IN AOBI HAVING ) 

DISPLAY-VALID IPI BUT ALSO IN AOBI INCLUDING AOBI HAVING 
I DISPLAY- INVALID IPI j 



PLAY BACK AND DISPLAY STILL IMAGE AND/OR TEXT 
(THAT CAN INCLUDE JACKET IMAGE, WORD CARD, ETC.) 
WHILE SWITCHING THEM ON THE BASIS OF ALL PIECES OF 
TRANSPLANTED (COPIED) INFORMATION 

(INCLUDING DISPLAY MODE INFORMATION AND/OR TEXT INFORMATION) 



ST2012 



END 



FIG. 26 



START 



ST3000 

J 



GENERATE MUSIC #y BY COMBINING MUSIC (TRACK) HAVING 
AOBI (TKI) #1 AND MUSIC (TRACK) # (3 HAVING AOBI (TKI) #2 
/IN THIS CASE, IN EXAMPLE IN FIG. 1 , TWO PIECES OF STILL IMAGE \ 
INFORMATION IMG_03. IOB AND IMG_04. IOB OF MUSIC #/? ARE 
MERGED WITH TWO PIECES OF STILL IMAGE INFORMATION IMGOI. 
IOB AND IMG_02. IOB SO THAT MUSIC #y HAS FOUR PIECES OF 
V IMAGE INFORMATION IMG_Q1. IOB TO IMG_04. IOB I 



USE DISPLAY MODE INFORMATION (51,52 IN FIG. 20) IN IMAGE POINTER 
INFORMATION IPI OF AOBI #1 OF MUSIC %a TO BE DISPLAYED FIRST IN 
COMBINED MUSIC (TRACK) #y, AS DISPLAY MODE INFORMATION OF 
COMBINED MUSIC $Y 



ST3004 — D0ES q | splay MODE 

INFORMATION USED INCLUDE DESCRIPTION OF DISPLAY^ 
SEQUENCE SET MODE INFORMATION 
ST3006 —^(51 IN FIG. 2(fn 



ST3002 
NO 



DETERMINE DISPLAY METHOD (SEQUENT I AL, RANDOM, SHUFFLE, BROWSE, ETC.) 
OF STILL IMAGE (IMG_xx. IOB) OF MUSIC #y IN ACCORDANCE WITH 
CONTENTS OF DISPLAY SEQUENCE SET MODE INFORMATION 



ST3008 



ST3010 



DOES DISPLAY MODE 
INFORMATION USED INCLUDE DESCRIPTION OF 
DISPLAY TIMING SET MODE INFORMATION 
(52 IN FIG. 20)? 

"YES 



NO 



DETERMINE DISPLAY TIMING 

(DISPLAY SWITCHING TIMING OF STILL IMAGE IS SYNCHRONIZED \ 
WITH BOUNDARY BETWEEN AUDIO FRAMES OF MUSIC #y TO BE PLAYED 
BACK, DISPLAY OF STILL IMAGES IS SWITCHED AT GIVEN TIME 
I INTERVALS USING TIMER, ETC. / 
OF STILL IMAGE (IMG_xx. IOB) OF MUSIC #y IN ACCORDANCE 
WITH CONTENTS OF DISPLAY TIMING SET MODE INFORMATION 



PLAY BACK AND DISPLAY STILL IMAGES 

(THAT CAN INCLUDE TEXT INFORMATION SUCH AS WORDS OR THE 
U_IKE AS NEEDED 

WHILE SWITCHING THEM BY DETERMINED DISPLAY METHOD (DISPLAY ORDER) 
AND/OR AT DETERMINED DISPLAY TIMING UPON PLAYBACK OF MUSIC #7 



ST3012 



END 



FIG. 27 



ST4000 



IS PLAY LIST 



DEFAULT PLAY LIST OR 
USER-DEFINED PLAY LIST 



SELECTED 



ST4002 

J 



ST4004 



YES 



SPECIFY FIRST MUSIC NUMBER 
/MUSIC §a IN DEFAULT PLAY ^ 
LIST OR MUSIC #/? IN 
USER-DEFINED PLAY LIST 
I IN FIG. 10 

IN SELECTED PLAY LIST 




ST4006 

{_ 



SPECIFIC MUSIC NUMBER 
(E.G., MUSIC #/? IN FIG. 10) 
IS DESIGNATED BY USER'S CHOICE 



ST4008 



ALLOW TO USE SOME OR ALL PIECES OF IMAGE INFORMATION 

IMG_02, I OB TO IMG_04. I OB FOR MUSIC $/3\ 

IN FIG- 10 J 
DESIGNATED BY IMAGE POINTER INFORMATION I PI OF SPECIFIED 
MUSIC NUMBER IN DISPLAY OF JACKET IMAGE AND/OR WORD CARD 
(TEXT IMAGE BASED ON TEXT POINTER INFORMATION TP I) ON THE 
BASIS OF CONTENTS OF RECORDED/UNRECORDED FLAG IN FIG. 16, 
17, OR 19, AND CONTENTS OF DESIGNATION PRESENCE/ABSENCE 
FLAG OF JACKET IMAGE OR THE LIKE IN FIG. 18 



DISPLAY IMAGE INFORMATION ALLOWED TO USE 
IMG_02, I OB TO IMG_04. I OB FOR MUSIC 
IN FIG. 10 

IN ACCORDANCE WITH DISPLAY METHOD (E.G., SEQUENTIAL) 
DESIGNATED BY DISPLAY SEQUENCE SET MODE INFORMATION 51 
CONTAINED IN DISPLAY MODE INFORMATION IN FIG. 10 OR 20, 
AND DISPLAY TIMING 

(E.G., IN UNITS OF PREDETERMINED NUMBER OF AUDIO FRAMES) 
DESIGNATED BY DISPLAY TIMING SET MODE INFORMATION 52 
INCLUDED IN DISPLAY MODE INFORMATION, UPON PLAYBACK OF 
SELECTED MUSIC NUMBER (MUSIC #/? IN FIG. 10) 



ST401 



END 



3 



FIG. 28 



DECLARATION FOR PATENT APPLICATION 



00S0738 



As a below named inventor, I declare: 

that I verily believe myself to be the original, first and so 
individual inventor is listed below) or an or i g i na 1 , f i r st and 
(if more than one individual inventor is listed below) of the 



SYSTEM FOR RECORDING AUDIO INFORMATION WITH IMAGE 



unless the folio 
ed States App 1 i ca 



I hereby state that I have reviewed and underst 
identified specification, including the claims, 
referred to above. 

I acknowledge the duty to disclose information of which is material to pat- 
entability as defined in 37 CFR 1.56. 

I hereby claim foreign priority benefits under 35 U. S. C. 119(a)-(d) or 365 
(b) of any foreign appl ication (s) for patent or inventor's certificate, or 
35 U. S. C. 36 5 (a) of any PCT International application which designated at 
least one country other than the United States, listed below and have also 
identified below any foreign application for patent or inventor's certifi- 
cate, or PCT International application having a filing date before that of the 
application on which priority is claimed: 



Category Appl ication No. Filing Date 

Patent 11-333389 November 24,1999 



And I hereby appoint Douglas B. He n d e r s o n (Re g. No. 2 0 , 2 9 1 ) , Ford F. 
Farabow, Jr. ( Re g . N o . 2 0 , 6 3 0 ) , Arthur S. Garrett (Reg. No. 20, 338) , Donald R. 
Dunner (Reg. No. 19, 073) , Brian G. Brunsvo 1 d (Reg. No. 22, 593), Tipton D. 
Jennings, IV (Reg. No. 20, 645), Jerry D. Voight (Reg. No. 23, 020), Laurence R. 
Hef ter (Reg. No. 20, 827) , Kenneth E. Pay ne (Re g. No. 23, 0 98) , Herbert H. Mintz 
(Reg. No. 26, 691) , C. Larry O' Rourke (Reg. No. 26, 014), Albert J. Santorelli 
(Reg. No. 22, 610), Michael C. Elmer (Reg. No. 25, 857), Richard H. Smith(Reg. 
No. 20, 609), Stephen L. P e t e r s o n (Re g. No. 26, 325), John M. Roma r y ( Re g. No . 
26 331 ), Bruce C. Z o 1 1 e r ( R e g . N o . 2 7 , 6 8 0 ) , Dennis P. O' Rei 1 ley (Reg. No. 
27,932), Allen M. Sokal (Reg. No. 26, 695), Robert D. Ba j e f sky (Reg. No. 25, 387 
), Richard L. Stroup(Reg. No. 28, 478), David W. H i 1 1 ( Re g . N o . 2 8 , 2 2 0 ) , 
Thomas L. Irving (Reg. No. 28, 619), Charles E. Lipsey (Reg. No. 28, 165), 
Thomas W. Wi al and (Reg. No. 27, 605), Basil J. Lewris (Reg. No. 28, 818) , Martin 
I. Fuchs (Reg. No. 28, 508), E. Robert Yoches (Reg. No. 30, 1 20), Barry W. Graham 
(Reg. No. 29, 924) , Susan Haberman G r i f f e n ( Re g . N o . 3 0 , 9 0 7 ) , Richard B.Racine 
(Re g. No. 3 0, 4 1 5) , Thomas H. Jenkins (Reg. No. 30, 857), Robert E.Converse, Jr. 
(Reg. No. 27, 432) , Clair X.Mullen, Jr. (Reg. No. 20, 348), Christopher P. Foley 
(Reg. No. 31, 354) , John C. P a u 1 ( R e g . No . 3 0 , 4 1 3 ) , David M. Kelly (Reg. No. 30, 953 
), Kenneth J. Meyers (Reg. No. 25, 146), Carol P. Einaudi (Reg. No. 32, 220), 
Walter Y. Boyd, Jr. (Reg. No. 31, 738), Steven M. Anza 1 one (Reg. No. 32, 095), 
Jean B. Fordis (Reg. No. 32, 984), Barbara C. McCurdy, ( Re g . N o . 3 2 , 1 2 0 ) , James 
K. Hammond (Reg. No. 31, 964) , Richard V. B u r gu j i a n ( Re g . N o . 3 1 , 7 4 4 ) , J.Michael 
Jakes (Reg. No. 32, 824) , Thomas W. Banks (Reg. No. 32, 719), M.Paul Barker(Reg. 
No. 32, 013) and Charles E. Van H o r n ( Re g . N o . 4 0 , 2 6 6 ) , each of whose address 
is 1300 I Street, N. W. , Washington, D . C . , 2 0 0 0 5 - 3 3 1 5 , or any one of them, 
my attorneys with full power of substitution and revocation, to 
prosecute this application and to transact all business in the Patent & 
Trademark Office connected therewith, and request that correspondence be 
directed to Finnegan, Henderson, Farabow, Garrett & Dunner, L. L. P. , 
1300 I Street, N. W. , Washington, D. C. , 20005-33 1 5. 

I declare further that all statements made herein of my own knowledge are 
true and that all statements made on information and belief are believed to 
be true; and further that these statements were made with the knowledge that 
willful false statements and the like so made are punishable by fine or im- 
prisonment, or both, under Section 1001 of Title 18 of the United States 
Code and that such willful false statements may jeopardize the validity of 
the application or any patent issued thereon. 
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I declare further that my post office 
Intellectual Property Division, KABUSHIKI 
1-chome, Minato-ku, Tokyo 105-8001, Japan 
that my citizenship and residence are as 



Inventor: (Signature) Date Reside: 




Date: 



Citizen of: Japan 



Date : 



Ci t izen of : Japan 



Date : 



Ci t izen of : Japan 



Date : 



Citizen of: Japan 



Date : 



Citizen of: Japan 



address is at c/o 

KAISHA TOSHIBA, 1-1 Shibaura 
and 

tated below next to my name: 



Citizen of: 



Japan 



